2026-02-19T20:58:01.751 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-19T20:58:01.770 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T20:58:01.855 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378 branch: wip-rocky10-branch-of-the-day-2026-02-06-1770413686 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} email: hyelloji@redhat.com first_in_suite: false flavor: default job_id: '58378' kernel: sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-rocky10-branch-of-the-day-2026-02-06-1770413686 ceph: cephfs: ec_profile: - disabled max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds use global snaprealm seq for subvol: false mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: a1ac97f8290bb2544f44f608df68f43689827c55 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: a1ac97f8290bb2544f44f608df68f43689827c55 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rocky10-branch-of-the-day-2026-02-06-1770413686 sha1: a1ac97f8290bb2544f44f608df68f43689827c55 owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5944 sha1: a1ac97f8290bb2544f44f608df68f43689827c55 sleep_before_teardown: 0 subset: 1007/1024 suite: fs suite_branch: wip-rocky10-branch-of-the-day-2026-02-06-1770413686 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: a1ac97f8290bb2544f44f608df68f43689827c55 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLjEnI+b1BS2ToFgIPbXJKWRv2bDkh0aBVcGb5krNugfQhLAQGV3A51ghPwhnYJlgWDtsau9PWRZk8mFEHH91qk= trial105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIi4K+nSgwDrBPjhjcgLnagTXtFNREs5vfMgX8ktoHDgGtsYJXKgte2+ipgVaYdnw6YyP+cayX1kN+pF9vwEBRw= trial175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmszDh9Ft2ur43tN46lKc+dWzCLLGoAkEY7tJ7eY6oz4juI5NA/7Nysch19h83b84ogZ9Cg+DnB+QjqtNUEY8Q= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - "local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\", yaml.kernel)\n\ \ py_attrgetter(yaml.kernel).pop('branch', nil)\n py_attrgetter(yaml.kernel).pop('deb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('flavor', nil)\n py_attrgetter(yaml.kernel).pop('kdb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('koji', nil)\n py_attrgetter(yaml.kernel).pop('koji_task',\ \ nil)\n py_attrgetter(yaml.kernel).pop('rpm', nil)\n py_attrgetter(yaml.kernel).pop('sha1',\ \ nil)\n py_attrgetter(yaml.kernel).pop('tag', nil)\nend\n" - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-19_12:04:07 tube: trial user: skanta verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-19T20:58:01.855 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa; will attempt to use it 2026-02-19T20:58:01.856 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks 2026-02-19T20:58:01.856 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-19T20:58:01.858 INFO:teuthology.task.internal:Checking packages... 2026-02-19T20:58:01.858 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash 'a1ac97f8290bb2544f44f608df68f43689827c55' 2026-02-19T20:58:01.858 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-19T20:58:01.858 INFO:teuthology.packaging:ref: None 2026-02-19T20:58:01.858 INFO:teuthology.packaging:tag: None 2026-02-19T20:58:01.858 INFO:teuthology.packaging:branch: wip-rocky10-branch-of-the-day-2026-02-06-1770413686 2026-02-19T20:58:01.858 INFO:teuthology.packaging:sha1: a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T20:58:01.858 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-rocky10-branch-of-the-day-2026-02-06-1770413686 2026-02-19T20:58:02.000 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5184.ga1ac97f8 2026-02-19T20:58:02.002 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-19T20:58:02.014 INFO:teuthology.task.internal:no buildpackages task found 2026-02-19T20:58:02.014 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-19T20:58:02.027 INFO:teuthology.task.internal:Saving configuration 2026-02-19T20:58:02.054 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-19T20:58:02.067 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-19T20:58:02.240 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial090.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 20:54:04.717148', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLjEnI+b1BS2ToFgIPbXJKWRv2bDkh0aBVcGb5krNugfQhLAQGV3A51ghPwhnYJlgWDtsau9PWRZk8mFEHH91qk='} 2026-02-19T20:58:02.298 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial105.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 20:54:04.718143', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIi4K+nSgwDrBPjhjcgLnagTXtFNREs5vfMgX8ktoHDgGtsYJXKgte2+ipgVaYdnw6YyP+cayX1kN+pF9vwEBRw='} 2026-02-19T20:58:02.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial175.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-19 20:54:04.717743', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPmszDh9Ft2ur43tN46lKc+dWzCLLGoAkEY7tJ7eY6oz4juI5NA/7Nysch19h83b84ogZ9Cg+DnB+QjqtNUEY8Q='} 2026-02-19T20:58:02.358 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-19T20:58:02.369 INFO:teuthology.task.internal:roles: ubuntu@trial090.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-19T20:58:02.369 INFO:teuthology.task.internal:roles: ubuntu@trial105.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-19T20:58:02.369 INFO:teuthology.task.internal:roles: ubuntu@trial175.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-19T20:58:02.369 INFO:teuthology.run_tasks:Running task console_log... 2026-02-19T20:58:02.567 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x72ecc77c2ac0>, signals=[15]) 2026-02-19T20:58:02.567 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-19T20:58:02.577 INFO:teuthology.task.internal:Opening connections... 2026-02-19T20:58:02.577 DEBUG:teuthology.task.internal:connecting to ubuntu@trial090.front.sepia.ceph.com 2026-02-19T20:58:02.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T20:58:02.640 DEBUG:teuthology.task.internal:connecting to ubuntu@trial105.front.sepia.ceph.com 2026-02-19T20:58:02.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T20:58:02.703 DEBUG:teuthology.task.internal:connecting to ubuntu@trial175.front.sepia.ceph.com 2026-02-19T20:58:02.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T20:58:02.767 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-19T20:58:02.779 DEBUG:teuthology.orchestra.run.trial090:> uname -m 2026-02-19T20:58:02.796 INFO:teuthology.orchestra.run.trial090.stdout:x86_64 2026-02-19T20:58:02.796 DEBUG:teuthology.orchestra.run.trial090:> cat /etc/os-release 2026-02-19T20:58:02.853 INFO:teuthology.orchestra.run.trial090.stdout:NAME="Rocky Linux" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:ID="rocky" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:VERSION_ID="10.1" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:PLATFORM_ID="platform:el10" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:ANSI_COLOR="0;32" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:LOGO="fedora-logo-icon" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:VENDOR_NAME="RESF" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:SUPPORT_END="2035-05-31" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T20:58:02.854 INFO:teuthology.orchestra.run.trial090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T20:58:02.855 INFO:teuthology.lock.ops:Updating trial090.front.sepia.ceph.com on lock server 2026-02-19T20:58:02.927 DEBUG:teuthology.orchestra.run.trial105:> uname -m 2026-02-19T20:58:02.944 INFO:teuthology.orchestra.run.trial105.stdout:x86_64 2026-02-19T20:58:02.944 DEBUG:teuthology.orchestra.run.trial105:> cat /etc/os-release 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:NAME="Rocky Linux" 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:ID="rocky" 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:VERSION_ID="10.1" 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:PLATFORM_ID="platform:el10" 2026-02-19T20:58:03.001 INFO:teuthology.orchestra.run.trial105.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:ANSI_COLOR="0;32" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:LOGO="fedora-logo-icon" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:VENDOR_NAME="RESF" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:SUPPORT_END="2035-05-31" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T20:58:03.002 INFO:teuthology.orchestra.run.trial105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T20:58:03.002 INFO:teuthology.lock.ops:Updating trial105.front.sepia.ceph.com on lock server 2026-02-19T20:58:03.079 DEBUG:teuthology.orchestra.run.trial175:> uname -m 2026-02-19T20:58:03.096 INFO:teuthology.orchestra.run.trial175.stdout:x86_64 2026-02-19T20:58:03.096 DEBUG:teuthology.orchestra.run.trial175:> cat /etc/os-release 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:NAME="Rocky Linux" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:VERSION="10.1 (Red Quartz)" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:ID="rocky" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:ID_LIKE="rhel centos fedora" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:VERSION_ID="10.1" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:PLATFORM_ID="platform:el10" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:ANSI_COLOR="0;32" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:LOGO="fedora-logo-icon" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:HOME_URL="https://rockylinux.org/" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:VENDOR_NAME="RESF" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:VENDOR_URL="https://resf.org/" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:SUPPORT_END="2035-05-31" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-19T20:58:03.153 INFO:teuthology.orchestra.run.trial175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-19T20:58:03.154 INFO:teuthology.lock.ops:Updating trial175.front.sepia.ceph.com on lock server 2026-02-19T20:58:03.233 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-19T20:58:03.248 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-19T20:58:03.259 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-19T20:58:03.259 DEBUG:teuthology.orchestra.run.trial090:> test '!' -e /home/ubuntu/cephtest 2026-02-19T20:58:03.260 DEBUG:teuthology.orchestra.run.trial105:> test '!' -e /home/ubuntu/cephtest 2026-02-19T20:58:03.262 DEBUG:teuthology.orchestra.run.trial175:> test '!' -e /home/ubuntu/cephtest 2026-02-19T20:58:03.278 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-19T20:58:03.289 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-19T20:58:03.289 DEBUG:teuthology.orchestra.run.trial090:> test -z $(ls -A /var/lib/ceph) 2026-02-19T20:58:03.317 DEBUG:teuthology.orchestra.run.trial105:> test -z $(ls -A /var/lib/ceph) 2026-02-19T20:58:03.319 DEBUG:teuthology.orchestra.run.trial175:> test -z $(ls -A /var/lib/ceph) 2026-02-19T20:58:03.333 INFO:teuthology.orchestra.run.trial090.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-19T20:58:03.335 INFO:teuthology.orchestra.run.trial105.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-19T20:58:03.336 INFO:teuthology.orchestra.run.trial175.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-19T20:58:03.337 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-19T20:58:03.566 INFO:teuthology.run_tasks:Running task kernel... 2026-02-19T20:58:03.585 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-19T20:58:03.585 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}, 'mon.b': {'sha1': 'distro'}, 'mon.c': {'sha1': 'distro'}}, timeout 300 2026-02-19T20:58:03.586 DEBUG:teuthology.orchestra.run.trial090:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T20:58:03.586 DEBUG:teuthology.orchestra.run.trial105:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T20:58:03.586 DEBUG:teuthology.orchestra.run.trial175:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-19T20:58:03.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T20:58:03.602 DEBUG:teuthology.orchestra.run.trial105:> uname -r 2026-02-19T20:58:03.602 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T20:58:03.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T20:58:03.603 DEBUG:teuthology.orchestra.run.trial090:> uname -r 2026-02-19T20:58:03.603 DEBUG:teuthology.orchestra.run.trial175:> uname -r 2026-02-19T20:58:03.659 INFO:teuthology.orchestra.run.trial105.stdout:6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:03.659 INFO:teuthology.task.kernel:Running kernel on trial105: 6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:03.659 DEBUG:teuthology.orchestra.run.trial105:> sudo yum install -y kernel 2026-02-19T20:58:03.661 INFO:teuthology.orchestra.run.trial090.stdout:6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:03.661 INFO:teuthology.task.kernel:Running kernel on trial090: 6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:03.661 DEBUG:teuthology.orchestra.run.trial090:> sudo yum install -y kernel 2026-02-19T20:58:03.662 INFO:teuthology.orchestra.run.trial175.stdout:6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:03.662 INFO:teuthology.task.kernel:Running kernel on trial175: 6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:03.662 DEBUG:teuthology.orchestra.run.trial175:> sudo yum install -y kernel 2026-02-19T20:58:04.169 INFO:teuthology.orchestra.run.trial105.stdout:Rocky Linux 10 - AppStream 24 MB/s | 2.2 MB 00:00 2026-02-19T20:58:04.177 INFO:teuthology.orchestra.run.trial175.stdout:Rocky Linux 10 - AppStream 24 MB/s | 2.2 MB 00:00 2026-02-19T20:58:04.178 INFO:teuthology.orchestra.run.trial090.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-19T20:58:04.512 INFO:teuthology.orchestra.run.trial105.stdout:Rocky Linux 10 - BaseOS 56 MB/s | 12 MB 00:00 2026-02-19T20:58:04.516 INFO:teuthology.orchestra.run.trial090.stdout:Rocky Linux 10 - BaseOS 56 MB/s | 12 MB 00:00 2026-02-19T20:58:04.558 INFO:teuthology.orchestra.run.trial175.stdout:Rocky Linux 10 - BaseOS 48 MB/s | 12 MB 00:00 2026-02-19T20:58:05.044 INFO:teuthology.orchestra.run.trial090.stdout:Rocky Linux 10 - CRB 6.0 MB/s | 508 kB 00:00 2026-02-19T20:58:05.053 INFO:teuthology.orchestra.run.trial105.stdout:Rocky Linux 10 - CRB 5.2 MB/s | 508 kB 00:00 2026-02-19T20:58:05.094 INFO:teuthology.orchestra.run.trial175.stdout:Rocky Linux 10 - CRB 6.2 MB/s | 508 kB 00:00 2026-02-19T20:58:05.704 INFO:teuthology.orchestra.run.trial175.stdout:Extra Packages for Enterprise Linux 11 MB/s | 6.2 MB 00:00 2026-02-19T20:58:05.823 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 6.2 MB 00:00 2026-02-19T20:58:06.139 INFO:teuthology.orchestra.run.trial105.stdout:Extra Packages for Enterprise Linux 6.0 MB/s | 6.2 MB 00:01 2026-02-19T20:58:06.383 INFO:teuthology.orchestra.run.trial175.stdout:lab-extras 127 kB/s | 3.7 kB 00:00 2026-02-19T20:58:06.487 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 297 kB/s | 3.7 kB 00:00 2026-02-19T20:58:06.794 INFO:teuthology.orchestra.run.trial175.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-19T20:58:06.794 INFO:teuthology.orchestra.run.trial175.stdout:Package kernel-6.12.0-124.35.1.el10_1.x86_64 is already installed. 2026-02-19T20:58:06.805 INFO:teuthology.orchestra.run.trial105.stdout:lab-extras 313 kB/s | 3.7 kB 00:00 2026-02-19T20:58:06.806 INFO:teuthology.orchestra.run.trial175.stdout:Dependencies resolved. 2026-02-19T20:58:06.807 INFO:teuthology.orchestra.run.trial175.stdout:Nothing to do. 2026-02-19T20:58:06.807 INFO:teuthology.orchestra.run.trial175.stdout:Complete! 2026-02-19T20:58:06.830 DEBUG:teuthology.orchestra.run.trial175:> echo no | sudo yum reinstall kernel || true 2026-02-19T20:58:06.895 INFO:teuthology.orchestra.run.trial090.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-19T20:58:06.895 INFO:teuthology.orchestra.run.trial090.stdout:Package kernel-6.12.0-124.35.1.el10_1.x86_64 is already installed. 2026-02-19T20:58:06.907 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-19T20:58:06.907 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-19T20:58:06.908 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-19T20:58:06.931 DEBUG:teuthology.orchestra.run.trial090:> echo no | sudo yum reinstall kernel || true 2026-02-19T20:58:07.111 INFO:teuthology.orchestra.run.trial175.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:58:06 PM UTC. 2026-02-19T20:58:07.146 INFO:teuthology.orchestra.run.trial175.stdout:Dependencies resolved. 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout: Package Architecture Version Repository Size 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:Reinstalling: 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:Transaction Summary 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:Total download size: 2.8 M 2026-02-19T20:58:07.147 INFO:teuthology.orchestra.run.trial175.stdout:Installed size: 0 2026-02-19T20:58:07.148 INFO:teuthology.orchestra.run.trial175.stderr:Operation aborted. 2026-02-19T20:58:07.166 INFO:teuthology.orchestra.run.trial175.stdout:Is this ok [y/N]: 2026-02-19T20:58:07.166 DEBUG:teuthology.orchestra.run.trial175:> sudo yum reinstall -y kernel || true 2026-02-19T20:58:07.211 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:58:06 PM UTC. 2026-02-19T20:58:07.212 INFO:teuthology.orchestra.run.trial105.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-19T20:58:07.212 INFO:teuthology.orchestra.run.trial105.stdout:Package kernel-6.12.0-124.35.1.el10_1.x86_64 is already installed. 2026-02-19T20:58:07.223 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-19T20:58:07.224 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-19T20:58:07.224 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-19T20:58:07.246 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-19T20:58:07.246 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T20:58:07.246 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-19T20:58:07.246 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T20:58:07.246 INFO:teuthology.orchestra.run.trial090.stdout:Reinstalling: 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.8 M 2026-02-19T20:58:07.247 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 0 2026-02-19T20:58:07.248 INFO:teuthology.orchestra.run.trial090.stderr:Operation aborted. 2026-02-19T20:58:07.248 DEBUG:teuthology.orchestra.run.trial105:> echo no | sudo yum reinstall kernel || true 2026-02-19T20:58:07.266 INFO:teuthology.orchestra.run.trial090.stdout:Is this ok [y/N]: 2026-02-19T20:58:07.266 DEBUG:teuthology.orchestra.run.trial090:> sudo yum reinstall -y kernel || true 2026-02-19T20:58:07.441 INFO:teuthology.orchestra.run.trial175.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:58:06 PM UTC. 2026-02-19T20:58:07.477 INFO:teuthology.orchestra.run.trial175.stdout:Dependencies resolved. 2026-02-19T20:58:07.477 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T20:58:07.477 INFO:teuthology.orchestra.run.trial175.stdout: Package Architecture Version Repository Size 2026-02-19T20:58:07.477 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T20:58:07.477 INFO:teuthology.orchestra.run.trial175.stdout:Reinstalling: 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout:Transaction Summary 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout:Total download size: 2.8 M 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout:Installed size: 0 2026-02-19T20:58:07.478 INFO:teuthology.orchestra.run.trial175.stdout:Downloading Packages: 2026-02-19T20:58:07.525 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:58:06 PM UTC. 2026-02-19T20:58:07.531 INFO:teuthology.orchestra.run.trial175.stdout:(1/2): kernel-6.12.0-124.27.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-19T20:58:07.540 INFO:teuthology.orchestra.run.trial175.stdout:(2/2): kernel-6.12.0-124.35.1.el10_1.x86_64.rpm 22 MB/s | 1.4 MB 00:00 2026-02-19T20:58:07.541 INFO:teuthology.orchestra.run.trial175.stdout:-------------------------------------------------------------------------------- 2026-02-19T20:58:07.541 INFO:teuthology.orchestra.run.trial175.stdout:Total 43 MB/s | 2.8 MB 00:00 2026-02-19T20:58:07.541 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction check 2026-02-19T20:58:07.544 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:58:06 PM UTC. 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout: Package Architecture Version Repository Size 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout:Reinstalling: 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.561 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T20:58:07.562 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-19T20:58:07.562 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T20:58:07.562 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T20:58:07.562 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 2.8 M 2026-02-19T20:58:07.562 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 0 2026-02-19T20:58:07.562 INFO:teuthology.orchestra.run.trial105.stderr:Operation aborted. 2026-02-19T20:58:07.580 INFO:teuthology.orchestra.run.trial105.stdout:Is this ok [y/N]: 2026-02-19T20:58:07.581 DEBUG:teuthology.orchestra.run.trial105:> sudo yum reinstall -y kernel || true 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout: Package Architecture Version Repository Size 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout:Reinstalling: 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.582 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T20:58:07.583 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-19T20:58:07.583 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T20:58:07.583 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T20:58:07.583 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.8 M 2026-02-19T20:58:07.583 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 0 2026-02-19T20:58:07.583 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-19T20:58:07.619 INFO:teuthology.orchestra.run.trial175.stdout:Transaction check succeeded. 2026-02-19T20:58:07.619 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction test 2026-02-19T20:58:07.634 INFO:teuthology.orchestra.run.trial090.stdout:(1/2): kernel-6.12.0-124.27.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-19T20:58:07.641 INFO:teuthology.orchestra.run.trial175.stdout:Transaction test succeeded. 2026-02-19T20:58:07.641 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction 2026-02-19T20:58:07.685 INFO:teuthology.orchestra.run.trial175.stdout: Preparing : 1/1 2026-02-19T20:58:07.692 INFO:teuthology.orchestra.run.trial175.stdout: Reinstalling : kernel-6.12.0-124.35.1.el10_1.x86_64 1/4 2026-02-19T20:58:07.695 INFO:teuthology.orchestra.run.trial175.stdout: Reinstalling : kernel-6.12.0-124.27.1.el10_1.x86_64 2/4 2026-02-19T20:58:07.697 INFO:teuthology.orchestra.run.trial175.stdout: Cleanup : kernel-6.12.0-124.35.1.el10_1.x86_64 3/4 2026-02-19T20:58:07.748 INFO:teuthology.orchestra.run.trial090.stdout:(2/2): kernel-6.12.0-124.35.1.el10_1.x86_64.rpm 8.4 MB/s | 1.4 MB 00:00 2026-02-19T20:58:07.748 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-19T20:58:07.748 INFO:teuthology.orchestra.run.trial090.stdout:Total 17 MB/s | 2.8 MB 00:00 2026-02-19T20:58:07.748 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-19T20:58:07.811 INFO:teuthology.orchestra.run.trial175.stdout: Cleanup : kernel-6.12.0-124.27.1.el10_1.x86_64 4/4 2026-02-19T20:58:07.811 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T20:58:07.812 INFO:teuthology.orchestra.run.trial175.stdout:Reinstalled: 2026-02-19T20:58:07.812 INFO:teuthology.orchestra.run.trial175.stdout: kernel-6.12.0-124.27.1.el10_1.x86_64 kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:07.812 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T20:58:07.812 INFO:teuthology.orchestra.run.trial175.stdout:Complete! 2026-02-19T20:58:07.827 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-19T20:58:07.827 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-19T20:58:07.838 DEBUG:teuthology.orchestra.run.trial175:> rpm -q kernel | sort -rV | head -n 1 2026-02-19T20:58:07.848 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-19T20:58:07.848 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-19T20:58:07.863 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Feb 2026 08:58:06 PM UTC. 2026-02-19T20:58:07.871 INFO:teuthology.orchestra.run.trial175.stdout:kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:07.872 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:07.872 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T20:58:07.872 DEBUG:teuthology.parallel:result is None 2026-02-19T20:58:07.893 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout: Package Architecture Version Repository Size 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout:Reinstalling: 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T20:58:07.898 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T20:58:07.899 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 2.8 M 2026-02-19T20:58:07.899 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 0 2026-02-19T20:58:07.899 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-19T20:58:07.900 INFO:teuthology.orchestra.run.trial090.stdout: Reinstalling : kernel-6.12.0-124.35.1.el10_1.x86_64 1/4 2026-02-19T20:58:07.903 INFO:teuthology.orchestra.run.trial090.stdout: Reinstalling : kernel-6.12.0-124.27.1.el10_1.x86_64 2/4 2026-02-19T20:58:07.904 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : kernel-6.12.0-124.35.1.el10_1.x86_64 3/4 2026-02-19T20:58:07.957 INFO:teuthology.orchestra.run.trial105.stdout:(1/2): kernel-6.12.0-124.27.1.el10_1.x86_64.rpm 24 MB/s | 1.4 MB 00:00 2026-02-19T20:58:08.006 INFO:teuthology.orchestra.run.trial105.stdout:(2/2): kernel-6.12.0-124.35.1.el10_1.x86_64.rpm 13 MB/s | 1.4 MB 00:00 2026-02-19T20:58:08.006 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-19T20:58:08.006 INFO:teuthology.orchestra.run.trial105.stdout:Total 26 MB/s | 2.8 MB 00:00 2026-02-19T20:58:08.006 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-19T20:58:08.017 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : kernel-6.12.0-124.27.1.el10_1.x86_64 4/4 2026-02-19T20:58:08.018 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T20:58:08.018 INFO:teuthology.orchestra.run.trial090.stdout:Reinstalled: 2026-02-19T20:58:08.018 INFO:teuthology.orchestra.run.trial090.stdout: kernel-6.12.0-124.27.1.el10_1.x86_64 kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:08.018 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T20:58:08.018 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-19T20:58:08.044 DEBUG:teuthology.orchestra.run.trial090:> rpm -q kernel | sort -rV | head -n 1 2026-02-19T20:58:08.075 INFO:teuthology.orchestra.run.trial090.stdout:kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:08.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:08.076 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T20:58:08.076 DEBUG:teuthology.parallel:result is None 2026-02-19T20:58:08.084 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-19T20:58:08.084 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-19T20:58:08.106 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-19T20:58:08.106 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-19T20:58:08.150 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-19T20:58:08.158 INFO:teuthology.orchestra.run.trial105.stdout: Reinstalling : kernel-6.12.0-124.35.1.el10_1.x86_64 1/4 2026-02-19T20:58:08.160 INFO:teuthology.orchestra.run.trial105.stdout: Reinstalling : kernel-6.12.0-124.27.1.el10_1.x86_64 2/4 2026-02-19T20:58:08.162 INFO:teuthology.orchestra.run.trial105.stdout: Cleanup : kernel-6.12.0-124.35.1.el10_1.x86_64 3/4 2026-02-19T20:58:08.275 INFO:teuthology.orchestra.run.trial105.stdout: Cleanup : kernel-6.12.0-124.27.1.el10_1.x86_64 4/4 2026-02-19T20:58:08.276 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T20:58:08.276 INFO:teuthology.orchestra.run.trial105.stdout:Reinstalled: 2026-02-19T20:58:08.276 INFO:teuthology.orchestra.run.trial105.stdout: kernel-6.12.0-124.27.1.el10_1.x86_64 kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:08.276 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T20:58:08.276 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-19T20:58:08.302 DEBUG:teuthology.orchestra.run.trial105:> rpm -q kernel | sort -rV | head -n 1 2026-02-19T20:58:08.336 INFO:teuthology.orchestra.run.trial105.stdout:kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:08.337 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.35.1.el10_1.x86_64 2026-02-19T20:58:08.337 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-19T20:58:08.337 DEBUG:teuthology.parallel:result is None 2026-02-19T20:58:08.337 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-19T20:58:08.351 INFO:teuthology.task.internal:Creating test directory... 2026-02-19T20:58:08.351 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T20:58:08.354 DEBUG:teuthology.orchestra.run.trial105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T20:58:08.379 DEBUG:teuthology.orchestra.run.trial175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-19T20:58:08.397 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-19T20:58:08.409 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-19T20:58:08.428 INFO:teuthology.task.internal:Creating archive directory... 2026-02-19T20:58:08.428 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T20:58:08.430 DEBUG:teuthology.orchestra.run.trial105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T20:58:08.436 DEBUG:teuthology.orchestra.run.trial175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-19T20:58:08.470 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-19T20:58:08.482 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-19T20:58:08.482 DEBUG:teuthology.orchestra.run.trial090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T20:58:08.489 DEBUG:teuthology.orchestra.run.trial105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T20:58:08.495 DEBUG:teuthology.orchestra.run.trial175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-19T20:58:08.513 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T20:58:08.519 INFO:teuthology.orchestra.run.trial105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T20:58:08.522 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T20:58:08.523 INFO:teuthology.orchestra.run.trial175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T20:58:08.529 INFO:teuthology.orchestra.run.trial105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T20:58:08.533 INFO:teuthology.orchestra.run.trial175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-19T20:58:08.534 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-19T20:58:08.546 INFO:teuthology.task.internal:Configuring sudo... 2026-02-19T20:58:08.547 DEBUG:teuthology.orchestra.run.trial090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T20:58:08.567 DEBUG:teuthology.orchestra.run.trial105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T20:58:08.573 DEBUG:teuthology.orchestra.run.trial175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-19T20:58:08.601 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-19T20:58:08.618 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-19T20:58:08.618 DEBUG:teuthology.orchestra.run.trial090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T20:58:08.634 DEBUG:teuthology.orchestra.run.trial105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T20:58:08.640 DEBUG:teuthology.orchestra.run.trial175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-19T20:58:08.658 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T20:58:08.814 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T20:58:08.842 DEBUG:teuthology.orchestra.run.trial090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T20:58:09.010 DEBUG:teuthology.orchestra.run.trial090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T20:58:09.039 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T20:58:09.039 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T20:58:09.106 DEBUG:teuthology.orchestra.run.trial105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T20:58:09.233 DEBUG:teuthology.orchestra.run.trial105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T20:58:09.261 DEBUG:teuthology.orchestra.run.trial105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T20:58:09.397 DEBUG:teuthology.orchestra.run.trial105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T20:58:09.427 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T20:58:09.427 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T20:58:09.494 DEBUG:teuthology.orchestra.run.trial175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T20:58:09.609 DEBUG:teuthology.orchestra.run.trial175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T20:58:09.637 DEBUG:teuthology.orchestra.run.trial175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T20:58:09.782 DEBUG:teuthology.orchestra.run.trial175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T20:58:09.808 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T20:58:09.808 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-19T20:58:09.874 DEBUG:teuthology.orchestra.run.trial090:> sudo service rsyslog restart 2026-02-19T20:58:09.877 DEBUG:teuthology.orchestra.run.trial105:> sudo service rsyslog restart 2026-02-19T20:58:09.880 DEBUG:teuthology.orchestra.run.trial175:> sudo service rsyslog restart 2026-02-19T20:58:09.906 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T20:58:09.909 INFO:teuthology.orchestra.run.trial105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T20:58:09.945 INFO:teuthology.orchestra.run.trial175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T20:58:10.436 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-19T20:58:10.449 INFO:teuthology.task.internal:Starting timer... 2026-02-19T20:58:10.449 INFO:teuthology.run_tasks:Running task pcp... 2026-02-19T20:58:10.470 INFO:teuthology.run_tasks:Running task selinux... 2026-02-19T20:58:10.488 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['comm="systemd".*denied.*\\{ prog_run \\}.*tclass=bpf.*permissive=1']} 2026-02-19T20:58:10.489 DEBUG:teuthology.orchestra.run.trial090:> sudo service auditd rotate 2026-02-19T20:58:10.520 INFO:teuthology.orchestra.run.trial090.stdout:Rotating logs: 2026-02-19T20:58:10.522 DEBUG:teuthology.orchestra.run.trial105:> sudo service auditd rotate 2026-02-19T20:58:10.554 INFO:teuthology.orchestra.run.trial105.stdout:Rotating logs: 2026-02-19T20:58:10.556 DEBUG:teuthology.orchestra.run.trial175:> sudo service auditd rotate 2026-02-19T20:58:10.587 INFO:teuthology.orchestra.run.trial175.stdout:Rotating logs: 2026-02-19T20:58:10.589 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-19T20:58:10.589 DEBUG:teuthology.orchestra.run.trial090:> /usr/sbin/getenforce 2026-02-19T20:58:10.608 INFO:teuthology.orchestra.run.trial090.stdout:Permissive 2026-02-19T20:58:10.609 DEBUG:teuthology.orchestra.run.trial105:> /usr/sbin/getenforce 2026-02-19T20:58:10.626 INFO:teuthology.orchestra.run.trial105.stdout:Permissive 2026-02-19T20:58:10.627 DEBUG:teuthology.orchestra.run.trial175:> /usr/sbin/getenforce 2026-02-19T20:58:10.647 INFO:teuthology.orchestra.run.trial175.stdout:Permissive 2026-02-19T20:58:10.648 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial090.front.sepia.ceph.com': 'permissive', 'ubuntu@trial105.front.sepia.ceph.com': 'permissive', 'ubuntu@trial175.front.sepia.ceph.com': 'permissive'} 2026-02-19T20:58:10.648 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-19T20:58:10.666 INFO:teuthology.orchestra.run.trial090.stderr:grep: Invalid content of \{\} 2026-02-19T20:58:10.675 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-19T20:58:10.676 DEBUG:teuthology.orchestra.run.trial105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-19T20:58:10.693 INFO:teuthology.orchestra.run.trial105.stderr:grep: Invalid content of \{\} 2026-02-19T20:58:10.703 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-19T20:58:10.704 DEBUG:teuthology.orchestra.run.trial175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-19T20:58:10.720 INFO:teuthology.orchestra.run.trial175.stderr:grep: Invalid content of \{\} 2026-02-19T20:58:10.730 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-19T20:58:10.731 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-19T20:58:10.731 DEBUG:teuthology.orchestra.run.trial090:> sudo /usr/sbin/setenforce permissive 2026-02-19T20:58:10.757 DEBUG:teuthology.orchestra.run.trial105:> sudo /usr/sbin/setenforce permissive 2026-02-19T20:58:10.783 DEBUG:teuthology.orchestra.run.trial175:> sudo /usr/sbin/setenforce permissive 2026-02-19T20:58:10.810 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-19T20:58:10.827 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-19T20:58:10.838 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-19T20:58:10.839 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial090.front.sepia.ceph.com,trial105.front.sepia.ceph.com,trial175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-19T21:01:01.361 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial090.front.sepia.ceph.com'), Remote(name='ubuntu@trial105.front.sepia.ceph.com'), Remote(name='ubuntu@trial175.front.sepia.ceph.com')] 2026-02-19T21:01:01.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-19T21:01:01.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:01:01.471 DEBUG:teuthology.orchestra.run.trial090:> true 2026-02-19T21:01:01.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial090.front.sepia.ceph.com' 2026-02-19T21:01:01.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-19T21:01:01.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:01:01.645 DEBUG:teuthology.orchestra.run.trial105:> true 2026-02-19T21:01:01.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial105.front.sepia.ceph.com' 2026-02-19T21:01:01.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial175.front.sepia.ceph.com' 2026-02-19T21:01:01.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-19T21:01:01.825 DEBUG:teuthology.orchestra.run.trial175:> true 2026-02-19T21:01:01.899 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial175.front.sepia.ceph.com' 2026-02-19T21:01:01.900 INFO:teuthology.run_tasks:Running task clock... 2026-02-19T21:01:01.913 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-19T21:01:01.913 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T21:01:01.914 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T21:01:01.916 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T21:01:01.916 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T21:01:01.918 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-19T21:01:01.919 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T21:01:01.944 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-19T21:01:01.946 INFO:teuthology.orchestra.run.trial105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-19T21:01:01.957 INFO:teuthology.orchestra.run.trial090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-19T21:01:01.959 INFO:teuthology.orchestra.run.trial105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-19T21:01:01.969 INFO:teuthology.orchestra.run.trial175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-19T21:01:01.980 INFO:teuthology.orchestra.run.trial090.stderr:sudo: ntpd: command not found 2026-02-19T21:01:01.981 INFO:teuthology.orchestra.run.trial105.stderr:sudo: ntpd: command not found 2026-02-19T21:01:01.982 INFO:teuthology.orchestra.run.trial175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-19T21:01:01.990 INFO:teuthology.orchestra.run.trial090.stdout:506 Cannot talk to daemon 2026-02-19T21:01:01.991 INFO:teuthology.orchestra.run.trial105.stdout:506 Cannot talk to daemon 2026-02-19T21:01:02.003 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-19T21:01:02.003 INFO:teuthology.orchestra.run.trial175.stderr:sudo: ntpd: command not found 2026-02-19T21:01:02.004 INFO:teuthology.orchestra.run.trial105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-19T21:01:02.013 INFO:teuthology.orchestra.run.trial175.stdout:506 Cannot talk to daemon 2026-02-19T21:01:02.015 INFO:teuthology.orchestra.run.trial090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-19T21:01:02.017 INFO:teuthology.orchestra.run.trial105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-19T21:01:02.026 INFO:teuthology.orchestra.run.trial175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-19T21:01:02.038 INFO:teuthology.orchestra.run.trial175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-19T21:01:02.065 INFO:teuthology.orchestra.run.trial105.stderr:bash: line 1: ntpq: command not found 2026-02-19T21:01:02.067 INFO:teuthology.orchestra.run.trial105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T21:01:02.067 INFO:teuthology.orchestra.run.trial105.stdout:=============================================================================== 2026-02-19T21:01:02.074 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-19T21:01:02.082 INFO:teuthology.orchestra.run.trial175.stderr:bash: line 1: ntpq: command not found 2026-02-19T21:01:02.090 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T21:01:02.090 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-19T21:01:02.090 INFO:teuthology.orchestra.run.trial090.stdout:^? 139-177-202-26.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.090 INFO:teuthology.orchestra.run.trial090.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.090 INFO:teuthology.orchestra.run.trial090.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.090 INFO:teuthology.orchestra.run.trial090.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.091 INFO:teuthology.orchestra.run.trial175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T21:01:02.091 INFO:teuthology.orchestra.run.trial175.stdout:=============================================================================== 2026-02-19T21:01:02.091 INFO:teuthology.orchestra.run.trial175.stdout:^? 172-234-25-10.ip.linodeu> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.092 INFO:teuthology.orchestra.run.trial175.stdout:^? sensei.ruselabs.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.092 INFO:teuthology.orchestra.run.trial175.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.092 INFO:teuthology.orchestra.run.trial175.stdout:^? 149.28.200.179.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-19T21:01:02.093 INFO:teuthology.run_tasks:Running task pexec... 2026-02-19T21:01:02.112 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-19T21:01:02.113 DEBUG:teuthology.orchestra.run.trial090:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-19T21:01:02.114 DEBUG:teuthology.orchestra.run.trial105:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-19T21:01:02.114 DEBUG:teuthology.orchestra.run.trial175:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-19T21:01:02.117 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial105.front.sepia.ceph.com 2026-02-19T21:01:02.117 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-19T21:01:02.117 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-19T21:01:02.134 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial175.front.sepia.ceph.com 2026-02-19T21:01:02.134 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-19T21:01:02.134 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-19T21:01:02.137 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial090.front.sepia.ceph.com 2026-02-19T21:01:02.137 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-19T21:01:02.137 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-19T21:01:02.292 INFO:teuthology.orchestra.run.trial105.stdout:No match for argument: nvme-cli 2026-02-19T21:01:02.293 INFO:teuthology.orchestra.run.trial105.stderr:No packages marked for removal. 2026-02-19T21:01:02.294 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-19T21:01:02.295 INFO:teuthology.orchestra.run.trial105.stdout:Nothing to do. 2026-02-19T21:01:02.295 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-19T21:01:02.313 INFO:teuthology.orchestra.run.trial175.stdout:No match for argument: nvme-cli 2026-02-19T21:01:02.314 INFO:teuthology.orchestra.run.trial175.stderr:No packages marked for removal. 2026-02-19T21:01:02.315 INFO:teuthology.orchestra.run.trial175.stdout:Dependencies resolved. 2026-02-19T21:01:02.316 INFO:teuthology.orchestra.run.trial175.stdout:Nothing to do. 2026-02-19T21:01:02.316 INFO:teuthology.orchestra.run.trial175.stdout:Complete! 2026-02-19T21:01:02.317 INFO:teuthology.orchestra.run.trial090.stdout:No match for argument: nvme-cli 2026-02-19T21:01:02.317 INFO:teuthology.orchestra.run.trial090.stderr:No packages marked for removal. 2026-02-19T21:01:02.319 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-19T21:01:02.320 INFO:teuthology.orchestra.run.trial090.stdout:Nothing to do. 2026-02-19T21:01:02.320 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-19T21:01:02.581 INFO:teuthology.orchestra.run.trial105.stdout:Last metadata expiration check: 0:00:30 ago on Thu 19 Feb 2026 09:00:32 PM UTC. 2026-02-19T21:01:02.600 INFO:teuthology.orchestra.run.trial175.stdout:Last metadata expiration check: 0:00:28 ago on Thu 19 Feb 2026 09:00:34 PM UTC. 2026-02-19T21:01:02.601 INFO:teuthology.orchestra.run.trial090.stdout:Last metadata expiration check: 0:00:28 ago on Thu 19 Feb 2026 09:00:34 PM UTC. 2026-02-19T21:01:02.617 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-19T21:01:02.617 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T21:01:02.617 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repository Size 2026-02-19T21:01:02.617 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T21:01:02.617 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-19T21:01:02.618 INFO:teuthology.orchestra.run.trial105.stdout:================================================================================ 2026-02-19T21:01:02.619 INFO:teuthology.orchestra.run.trial105.stdout:Install 8 Packages 2026-02-19T21:01:02.619 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:02.619 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 2.8 M 2026-02-19T21:01:02.619 INFO:teuthology.orchestra.run.trial105.stdout:Installed size: 13 M 2026-02-19T21:01:02.619 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-19T21:01:02.636 INFO:teuthology.orchestra.run.trial175.stdout:Dependencies resolved. 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: Package Arch Version Repository Size 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout:Installing: 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout:Installing dependencies: 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-19T21:01:02.637 INFO:teuthology.orchestra.run.trial175.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout:Transaction Summary 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout:================================================================================ 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout:Install 8 Packages 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout:Total download size: 2.8 M 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout:Installed size: 13 M 2026-02-19T21:01:02.638 INFO:teuthology.orchestra.run.trial175.stdout:Downloading Packages: 2026-02-19T21:01:02.639 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-19T21:01:02.639 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T21:01:02.639 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-19T21:01:02.639 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T21:01:02.639 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-19T21:01:02.640 INFO:teuthology.orchestra.run.trial090.stdout:================================================================================ 2026-02-19T21:01:02.641 INFO:teuthology.orchestra.run.trial090.stdout:Install 8 Packages 2026-02-19T21:01:02.641 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:02.641 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 2.8 M 2026-02-19T21:01:02.641 INFO:teuthology.orchestra.run.trial090.stdout:Installed size: 13 M 2026-02-19T21:01:02.641 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-19T21:01:02.656 INFO:teuthology.orchestra.run.trial105.stdout:(1/8): python3-configshell-1.1.30-8.el10.noarch 2.3 MB/s | 90 kB 00:00 2026-02-19T21:01:02.659 INFO:teuthology.orchestra.run.trial105.stdout:(2/8): nvmetcli-0.8-1.el10.noarch.rpm 1.3 MB/s | 54 kB 00:00 2026-02-19T21:01:02.675 INFO:teuthology.orchestra.run.trial175.stdout:(1/8): nvmetcli-0.8-1.el10.noarch.rpm 1.4 MB/s | 54 kB 00:00 2026-02-19T21:01:02.676 INFO:teuthology.orchestra.run.trial090.stdout:(1/8): nvmetcli-0.8-1.el10.noarch.rpm 1.4 MB/s | 54 kB 00:00 2026-02-19T21:01:02.677 INFO:teuthology.orchestra.run.trial105.stdout:(3/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 5.4 MB/s | 111 kB 00:00 2026-02-19T21:01:02.678 INFO:teuthology.orchestra.run.trial175.stdout:(2/8): python3-configshell-1.1.30-8.el10.noarch 2.2 MB/s | 90 kB 00:00 2026-02-19T21:01:02.687 INFO:teuthology.orchestra.run.trial090.stdout:(2/8): nvme-cli-2.13-2.el10.x86_64.rpm 23 MB/s | 1.1 MB 00:00 2026-02-19T21:01:02.687 INFO:teuthology.orchestra.run.trial090.stdout:(3/8): python3-configshell-1.1.30-8.el10.noarch 1.8 MB/s | 90 kB 00:00 2026-02-19T21:01:02.695 INFO:teuthology.orchestra.run.trial175.stdout:(3/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 5.5 MB/s | 111 kB 00:00 2026-02-19T21:01:02.701 INFO:teuthology.orchestra.run.trial105.stdout:(4/8): python3-typing-extensions-4.9.0-6.el10.n 3.0 MB/s | 77 kB 00:00 2026-02-19T21:01:02.703 INFO:teuthology.orchestra.run.trial090.stdout:(4/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 4.1 MB/s | 111 kB 00:00 2026-02-19T21:01:02.704 INFO:teuthology.orchestra.run.trial090.stdout:(5/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 16 MB/s | 271 kB 00:00 2026-02-19T21:01:02.704 INFO:teuthology.orchestra.run.trial090.stdout:(6/8): python3-typing-extensions-4.9.0-6.el10.n 4.4 MB/s | 77 kB 00:00 2026-02-19T21:01:02.705 INFO:teuthology.orchestra.run.trial105.stdout:(5/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 5.8 MB/s | 271 kB 00:00 2026-02-19T21:01:02.707 INFO:teuthology.orchestra.run.trial175.stdout:(4/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 9.1 MB/s | 271 kB 00:00 2026-02-19T21:01:02.714 INFO:teuthology.orchestra.run.trial175.stdout:(5/8): python3-typing-extensions-4.9.0-6.el10.n 4.0 MB/s | 77 kB 00:00 2026-02-19T21:01:02.718 INFO:teuthology.orchestra.run.trial090.stdout:(7/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 3.3 MB/s | 48 kB 00:00 2026-02-19T21:01:02.726 INFO:teuthology.orchestra.run.trial105.stdout:(6/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 2.2 MB/s | 48 kB 00:00 2026-02-19T21:01:02.732 INFO:teuthology.orchestra.run.trial175.stdout:(6/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 2.6 MB/s | 48 kB 00:00 2026-02-19T21:01:02.738 INFO:teuthology.orchestra.run.trial090.stdout:(8/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 30 MB/s | 1.1 MB 00:00 2026-02-19T21:01:02.739 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:01:02.739 INFO:teuthology.orchestra.run.trial090.stdout:Total 28 MB/s | 2.8 MB 00:00 2026-02-19T21:01:02.739 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-19T21:01:02.739 INFO:teuthology.orchestra.run.trial105.stdout:(7/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 28 MB/s | 1.1 MB 00:00 2026-02-19T21:01:02.741 INFO:teuthology.orchestra.run.trial175.stdout:(7/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 30 MB/s | 1.1 MB 00:00 2026-02-19T21:01:02.747 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-19T21:01:02.747 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-19T21:01:02.788 INFO:teuthology.orchestra.run.trial175.stdout:(8/8): nvme-cli-2.13-2.el10.x86_64.rpm 7.4 MB/s | 1.1 MB 00:00 2026-02-19T21:01:02.789 INFO:teuthology.orchestra.run.trial175.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:01:02.789 INFO:teuthology.orchestra.run.trial175.stdout:Total 18 MB/s | 2.8 MB 00:00 2026-02-19T21:01:02.789 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction check 2026-02-19T21:01:02.790 INFO:teuthology.orchestra.run.trial105.stdout:(8/8): nvme-cli-2.13-2.el10.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2026-02-19T21:01:02.790 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:01:02.790 INFO:teuthology.orchestra.run.trial105.stdout:Total 16 MB/s | 2.8 MB 00:00 2026-02-19T21:01:02.790 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-19T21:01:02.797 INFO:teuthology.orchestra.run.trial175.stdout:Transaction check succeeded. 2026-02-19T21:01:02.797 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction test 2026-02-19T21:01:02.797 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-19T21:01:02.797 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-19T21:01:02.815 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-19T21:01:02.815 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-19T21:01:02.863 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-19T21:01:02.863 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-19T21:01:02.864 INFO:teuthology.orchestra.run.trial175.stdout:Transaction test succeeded. 2026-02-19T21:01:02.864 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction 2026-02-19T21:01:02.886 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-19T21:01:02.889 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-19T21:01:02.915 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-19T21:01:02.923 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-19T21:01:02.927 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-19T21:01:02.932 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-19T21:01:02.932 INFO:teuthology.orchestra.run.trial175.stdout: Preparing : 1/1 2026-02-19T21:01:02.932 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-19T21:01:02.935 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-19T21:01:02.936 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-19T21:01:02.937 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-19T21:01:02.938 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-19T21:01:02.961 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-19T21:01:02.962 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-19T21:01:02.968 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-19T21:01:02.969 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-19T21:01:02.972 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-19T21:01:02.973 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-19T21:01:02.976 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-19T21:01:02.977 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-19T21:01:02.980 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-19T21:01:02.981 INFO:teuthology.orchestra.run.trial105.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-19T21:01:02.982 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-19T21:01:02.983 INFO:teuthology.orchestra.run.trial175.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-19T21:01:02.995 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-19T21:01:02.998 INFO:teuthology.orchestra.run.trial090.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-19T21:01:03.038 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-19T21:01:03.038 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-19T21:01:03.040 INFO:teuthology.orchestra.run.trial105.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-19T21:01:03.041 INFO:teuthology.orchestra.run.trial175.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-19T21:01:03.246 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-19T21:01:03.247 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-19T21:01:03.247 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:03.291 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-19T21:01:03.292 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-19T21:01:03.292 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:03.293 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-19T21:01:03.293 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-19T21:01:03.293 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:03.578 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-19T21:01:03.606 DEBUG:teuthology.parallel:result is None 2026-02-19T21:01:03.611 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:03.611 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-19T21:01:03.611 INFO:teuthology.orchestra.run.trial105.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-19T21:01:03.611 INFO:teuthology.orchestra.run.trial105.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-19T21:01:03.611 INFO:teuthology.orchestra.run.trial105.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:03.612 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout:Installed: 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-19T21:01:03.613 INFO:teuthology.orchestra.run.trial175.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-19T21:01:03.614 INFO:teuthology.orchestra.run.trial175.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-19T21:01:03.614 INFO:teuthology.orchestra.run.trial175.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-19T21:01:03.614 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:03.614 INFO:teuthology.orchestra.run.trial175.stdout:Complete! 2026-02-19T21:01:03.639 DEBUG:teuthology.parallel:result is None 2026-02-19T21:01:03.643 DEBUG:teuthology.parallel:result is None 2026-02-19T21:01:03.643 INFO:teuthology.run_tasks:Running task install... 2026-02-19T21:01:03.657 DEBUG:teuthology.task.install:project ceph 2026-02-19T21:01:03.657 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55'}} 2026-02-19T21:01:03.657 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55'} 2026-02-19T21:01:03.657 INFO:teuthology.task.install:Using flavor: default 2026-02-19T21:01:03.666 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-19T21:01:03.666 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-19T21:01:03.667 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55', 'tag': None, 'wait_for_package': False} 2026-02-19T21:01:03.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:03.671 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55', 'tag': None, 'wait_for_package': False} 2026-02-19T21:01:03.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:03.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55', 'tag': None, 'wait_for_package': False} 2026-02-19T21:01:03.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:03.910 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/ 2026-02-19T21:01:03.910 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5184.ga1ac97f8 2026-02-19T21:01:03.922 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/ 2026-02-19T21:01:03.922 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5184.ga1ac97f8 2026-02-19T21:01:03.923 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/ 2026-02-19T21:01:03.923 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5184.ga1ac97f8 2026-02-19T21:01:04.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-19T21:01:04.119 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:01:04.120 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-19T21:01:04.121 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-19T21:01:04.121 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:01:04.121 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-19T21:01:04.129 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-19T21:01:04.129 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:01:04.130 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-19T21:01:04.154 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-19T21:01:04.155 DEBUG:teuthology.orchestra.run.trial090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a1ac97f8290bb2544f44f608df68f43689827c55/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-19T21:01:04.158 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-19T21:01:04.159 DEBUG:teuthology.orchestra.run.trial105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a1ac97f8290bb2544f44f608df68f43689827c55/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-19T21:01:04.180 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-19T21:01:04.180 DEBUG:teuthology.orchestra.run.trial175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a1ac97f8290bb2544f44f608df68f43689827c55/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-19T21:01:04.207 DEBUG:teuthology.orchestra.run.trial175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-19T21:01:04.221 DEBUG:teuthology.orchestra.run.trial090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-19T21:01:04.226 DEBUG:teuthology.orchestra.run.trial105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-19T21:01:04.285 DEBUG:teuthology.orchestra.run.trial175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-19T21:01:04.298 DEBUG:teuthology.orchestra.run.trial090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-19T21:01:04.305 DEBUG:teuthology.orchestra.run.trial105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-19T21:01:04.350 INFO:teuthology.orchestra.run.trial175.stdout:check_obsoletes = 1 2026-02-19T21:01:04.351 DEBUG:teuthology.orchestra.run.trial175:> sudo yum clean all 2026-02-19T21:01:04.364 INFO:teuthology.orchestra.run.trial090.stdout:check_obsoletes = 1 2026-02-19T21:01:04.366 DEBUG:teuthology.orchestra.run.trial090:> sudo yum clean all 2026-02-19T21:01:04.371 INFO:teuthology.orchestra.run.trial105.stdout:check_obsoletes = 1 2026-02-19T21:01:04.373 DEBUG:teuthology.orchestra.run.trial105:> sudo yum clean all 2026-02-19T21:01:04.501 INFO:teuthology.orchestra.run.trial175.stdout:28 files removed 2026-02-19T21:01:04.515 INFO:teuthology.orchestra.run.trial090.stdout:28 files removed 2026-02-19T21:01:04.517 DEBUG:teuthology.orchestra.run.trial175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-19T21:01:04.524 INFO:teuthology.orchestra.run.trial105.stdout:28 files removed 2026-02-19T21:01:04.530 DEBUG:teuthology.orchestra.run.trial090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-19T21:01:04.539 DEBUG:teuthology.orchestra.run.trial105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-19T21:01:04.793 INFO:teuthology.orchestra.run.trial175.stdout:ceph packages for x86_64 213 kB/s | 26 kB 00:00 2026-02-19T21:01:04.793 INFO:teuthology.orchestra.run.trial090.stdout:ceph packages for x86_64 233 kB/s | 26 kB 00:00 2026-02-19T21:01:04.796 INFO:teuthology.orchestra.run.trial105.stdout:ceph packages for x86_64 239 kB/s | 26 kB 00:00 2026-02-19T21:01:04.897 INFO:teuthology.orchestra.run.trial175.stdout:ceph noarch packages 40 kB/s | 3.9 kB 00:00 2026-02-19T21:01:04.898 INFO:teuthology.orchestra.run.trial090.stdout:ceph noarch packages 40 kB/s | 3.9 kB 00:00 2026-02-19T21:01:04.901 INFO:teuthology.orchestra.run.trial105.stdout:ceph noarch packages 41 kB/s | 3.9 kB 00:00 2026-02-19T21:01:05.000 INFO:teuthology.orchestra.run.trial090.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2026-02-19T21:01:05.001 INFO:teuthology.orchestra.run.trial175.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2026-02-19T21:01:05.004 INFO:teuthology.orchestra.run.trial105.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2026-02-19T21:01:05.094 INFO:teuthology.orchestra.run.trial090.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-19T21:01:05.095 INFO:teuthology.orchestra.run.trial175.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-19T21:01:05.097 INFO:teuthology.orchestra.run.trial105.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-19T21:01:05.431 INFO:teuthology.orchestra.run.trial105.stdout:Rocky Linux 10 - BaseOS 59 MB/s | 12 MB 00:00 2026-02-19T21:01:05.442 INFO:teuthology.orchestra.run.trial090.stdout:Rocky Linux 10 - BaseOS 54 MB/s | 12 MB 00:00 2026-02-19T21:01:05.449 INFO:teuthology.orchestra.run.trial175.stdout:Rocky Linux 10 - BaseOS 53 MB/s | 12 MB 00:00 2026-02-19T21:01:05.959 INFO:teuthology.orchestra.run.trial105.stdout:Rocky Linux 10 - CRB 6.1 MB/s | 508 kB 00:00 2026-02-19T21:01:05.980 INFO:teuthology.orchestra.run.trial090.stdout:Rocky Linux 10 - CRB 5.3 MB/s | 508 kB 00:00 2026-02-19T21:01:05.990 INFO:teuthology.orchestra.run.trial175.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 508 kB 00:00 2026-02-19T21:01:06.507 INFO:teuthology.orchestra.run.trial090.stdout:Extra Packages for Enterprise Linux 13 MB/s | 6.2 MB 00:00 2026-02-19T21:01:06.969 INFO:teuthology.orchestra.run.trial105.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 6.2 MB 00:00 2026-02-19T21:01:07.176 INFO:teuthology.orchestra.run.trial090.stdout:lab-extras 311 kB/s | 3.7 kB 00:00 2026-02-19T21:01:07.433 INFO:teuthology.orchestra.run.trial175.stdout:Extra Packages for Enterprise Linux 4.5 MB/s | 6.2 MB 00:01 2026-02-19T21:01:07.636 INFO:teuthology.orchestra.run.trial105.stdout:lab-extras 322 kB/s | 3.7 kB 00:00 2026-02-19T21:01:07.683 INFO:teuthology.orchestra.run.trial090.stdout:Package librados2-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-19T21:01:07.683 INFO:teuthology.orchestra.run.trial090.stdout:Package librbd1-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-19T21:01:07.687 INFO:teuthology.orchestra.run.trial090.stdout:Package NetworkManager-1:1.54.0-2.el10_1.x86_64 is already installed. 2026-02-19T21:01:07.687 INFO:teuthology.orchestra.run.trial090.stdout:Package iproute-6.14.0-2.el10.x86_64 is already installed. 2026-02-19T21:01:07.688 INFO:teuthology.orchestra.run.trial090.stdout:Package util-linux-2.40.2-15.el10_1.x86_64 is already installed. 2026-02-19T21:01:07.688 INFO:teuthology.orchestra.run.trial090.stdout:Package libacl-devel-2.3.2-4.el10.x86_64 is already installed. 2026-02-19T21:01:07.688 INFO:teuthology.orchestra.run.trial090.stdout:Package libattr-devel-2.5.2-5.el10.x86_64 is already installed. 2026-02-19T21:01:07.689 INFO:teuthology.orchestra.run.trial090.stdout:Package xfsdump-3.2.0-1.el10.x86_64 is already installed. 2026-02-19T21:01:07.689 INFO:teuthology.orchestra.run.trial090.stdout:Package xfsprogs-6.11.0-2.el10.x86_64 is already installed. 2026-02-19T21:01:07.708 INFO:teuthology.orchestra.run.trial090.stdout:Dependencies resolved. 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================== 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout: Package Arch Version Repository Size 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================== 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout:Installing: 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout: bison x86_64 3.8.2-9.el10 appstream 1.0 M 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout: ceph x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.6 k 2026-02-19T21:01:07.712 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 5.3 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 1.1 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 152 k 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 985 k 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 184 k 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 15 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 7.4 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 50 k 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 176 k 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-classic x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 17 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 14 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 81 M 2026-02-19T21:01:07.713 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 374 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: cephadm noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 1.3 M 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-mirror x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 252 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-shell x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 27 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-top noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 18 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: elfutils-libelf-devel x86_64 0.193-1.el10.rocky.0.1 appstream 48 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: flex x86_64 2.6.4-19.el10 appstream 300 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: libaio-devel x86_64 0.3.111-22.el10 appstream 10 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 37 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 937 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 128 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: libtool x86_64 2.4.7-13.el10 appstream 601 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: libuuid-devel x86_64 2.40.2-15.el10_1 appstream 37 k 2026-02-19T21:01:07.714 INFO:teuthology.orchestra.run.trial090.stdout: openssl-devel x86_64 1:3.5.1-7.el10_1 appstream 3.0 M 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: postgresql x86_64 16.11-1.el10_1 appstream 2.0 M 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-contrib x86_64 16.11-1.el10_1 appstream 1.0 M 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-server x86_64 16.11-1.el10_1 appstream 7.0 M 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 253 k 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 353 k 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 371 k 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 130 k 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 87 k 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.9 M 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 179 k 2026-02-19T21:01:07.715 INFO:teuthology.orchestra.run.trial090.stdout: xfsprogs-devel x86_64 6.11.0-2.el10 appstream 105 k 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout:Upgrading: 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: librados2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 3.6 M 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: librbd1 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.8 M 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout:Installing dependencies: 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: automake noarch 1.16.5-20.el10 appstream 704 k 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 M 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 57 k 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.4 M 2026-02-19T21:01:07.716 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 297 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.0 M 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-crimson x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 20 M 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 17 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: cmake-filesystem x86_64 3.30.5-3.el10_0 appstream 15 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-19T21:01:07.717 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 168 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-19T21:01:07.718 INFO:teuthology.orchestra.run.trial090.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 251 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: librgw2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.7 M 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-19T21:01:07.719 INFO:teuthology.orchestra.run.trial090.stdout: libzstd-devel x86_64 1.5.5-9.el10 appstream 51 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-19T21:01:07.720 INFO:teuthology.orchestra.run.trial090.stdout: perl-Thread-Queue noarch 3.14-511.el10 appstream 21 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads x86_64 1:2.40-511.el10 appstream 58 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads-shared x86_64 1.69-511.el10 appstream 45 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-private-libs x86_64 16.11-1.el10_1 appstream 143 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 57 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 237 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-19T21:01:07.721 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-cmd2 noarch 2.5.8-1.el10_2 epel 375 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-colorama noarch 0.4.6-13.el10 appstream 74 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel x86_64 3.12.12-3.el10_1 appstream 329 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-19T21:01:07.722 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-19T21:01:07.723 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyperclip noarch 1.8.2-1.el10_0 epel 28 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-19T21:01:07.724 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-19T21:01:07.725 INFO:teuthology.orchestra.run.trial090.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: uuid x86_64 1.6.2-65.el10 appstream 59 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: zlib-ng-compat-devel x86_64 2.2.3-3.el10_1 appstream 36 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout:Installing weak dependencies: 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 22 k 2026-02-19T21:01:07.726 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 36 k 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout:Transaction Summary 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout:======================================================================================== 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout:Install 173 Packages 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout:Upgrade 2 Packages 2026-02-19T21:01:07.727 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:07.728 INFO:teuthology.orchestra.run.trial090.stdout:Total download size: 298 M 2026-02-19T21:01:07.728 INFO:teuthology.orchestra.run.trial090.stdout:Downloading Packages: 2026-02-19T21:01:07.840 INFO:teuthology.orchestra.run.trial090.stdout:(1/175): ceph-20.3.0-5184.ga1ac97f8.el10.x86_64 137 kB/s | 6.6 kB 00:00 2026-02-19T21:01:07.941 INFO:teuthology.orchestra.run.trial090.stdout:(2/175): ceph-fuse-20.3.0-5184.ga1ac97f8.el10.x 10 MB/s | 1.1 MB 00:00 2026-02-19T21:01:07.978 INFO:teuthology.orchestra.run.trial090.stdout:(3/175): ceph-immutable-object-cache-20.3.0-518 4.0 MB/s | 152 kB 00:00 2026-02-19T21:01:08.100 INFO:teuthology.orchestra.run.trial175.stdout:lab-extras 319 kB/s | 3.7 kB 00:00 2026-02-19T21:01:08.102 INFO:teuthology.orchestra.run.trial090.stdout:(4/175): ceph-base-20.3.0-5184.ga1ac97f8.el10.x 17 MB/s | 5.3 MB 00:00 2026-02-19T21:01:08.127 INFO:teuthology.orchestra.run.trial090.stdout:(5/175): ceph-mds-20.3.0-5184.ga1ac97f8.el10.x8 16 MB/s | 2.4 MB 00:00 2026-02-19T21:01:08.142 INFO:teuthology.orchestra.run.trial105.stdout:Package librados2-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-19T21:01:08.142 INFO:teuthology.orchestra.run.trial105.stdout:Package librbd1-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-19T21:01:08.146 INFO:teuthology.orchestra.run.trial105.stdout:Package NetworkManager-1:1.54.0-2.el10_1.x86_64 is already installed. 2026-02-19T21:01:08.146 INFO:teuthology.orchestra.run.trial105.stdout:Package iproute-6.14.0-2.el10.x86_64 is already installed. 2026-02-19T21:01:08.147 INFO:teuthology.orchestra.run.trial105.stdout:Package util-linux-2.40.2-15.el10_1.x86_64 is already installed. 2026-02-19T21:01:08.147 INFO:teuthology.orchestra.run.trial105.stdout:Package libacl-devel-2.3.2-4.el10.x86_64 is already installed. 2026-02-19T21:01:08.148 INFO:teuthology.orchestra.run.trial105.stdout:Package libattr-devel-2.5.2-5.el10.x86_64 is already installed. 2026-02-19T21:01:08.148 INFO:teuthology.orchestra.run.trial105.stdout:Package xfsdump-3.2.0-1.el10.x86_64 is already installed. 2026-02-19T21:01:08.149 INFO:teuthology.orchestra.run.trial105.stdout:Package xfsprogs-6.11.0-2.el10.x86_64 is already installed. 2026-02-19T21:01:08.150 INFO:teuthology.orchestra.run.trial090.stdout:(6/175): ceph-mgr-20.3.0-5184.ga1ac97f8.el10.x8 20 MB/s | 985 kB 00:00 2026-02-19T21:01:08.168 INFO:teuthology.orchestra.run.trial105.stdout:Dependencies resolved. 2026-02-19T21:01:08.171 INFO:teuthology.orchestra.run.trial105.stdout:======================================================================================== 2026-02-19T21:01:08.171 INFO:teuthology.orchestra.run.trial105.stdout: Package Arch Version Repository Size 2026-02-19T21:01:08.171 INFO:teuthology.orchestra.run.trial105.stdout:======================================================================================== 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout:Installing: 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: bison x86_64 3.8.2-9.el10 appstream 1.0 M 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.6 k 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-base x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 5.3 M 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-fuse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 1.1 M 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 152 k 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 985 k 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 184 k 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 15 M 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 7.4 M 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-rook noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 50 k 2026-02-19T21:01:08.172 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 176 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-classic x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 17 M 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: ceph-radosgw x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 14 M 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: ceph-test x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 81 M 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: ceph-volume noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 374 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: cephadm noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 1.3 M 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: cephfs-mirror x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 252 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: cephfs-shell x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 27 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: cephfs-top noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 18 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: elfutils-libelf-devel x86_64 0.193-1.el10.rocky.0.1 appstream 48 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: flex x86_64 2.6.4-19.el10 appstream 300 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: libaio-devel x86_64 0.3.111-22.el10 appstream 10 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-devel x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 37 k 2026-02-19T21:01:08.173 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 937 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: librados-devel x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 128 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: libtool x86_64 2.4.7-13.el10 appstream 601 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: libuuid-devel x86_64 2.40.2-15.el10_1 appstream 37 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: openssl-devel x86_64 1:3.5.1-7.el10_1 appstream 3.0 M 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: postgresql x86_64 16.11-1.el10_1 appstream 2.0 M 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-contrib x86_64 16.11-1.el10_1 appstream 1.0 M 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-server x86_64 16.11-1.el10_1 appstream 7.0 M 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: python3-cephfs x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 253 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: python3-rados x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 353 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: python3-rbd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 371 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: python3-rgw x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 130 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: rbd-fuse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 87 k 2026-02-19T21:01:08.174 INFO:teuthology.orchestra.run.trial105.stdout: rbd-mirror x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.9 M 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: rbd-nbd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 179 k 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: xfsprogs-devel x86_64 6.11.0-2.el10 appstream 105 k 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout:Upgrading: 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: librados2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 3.6 M 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: librbd1 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.8 M 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout:Installing dependencies: 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: automake noarch 1.16.5-20.el10 appstream 704 k 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: ceph-common x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 M 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 57 k 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mds x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.4 M 2026-02-19T21:01:08.175 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 297 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mon x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.0 M 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-crimson x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 20 M 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 17 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: ceph-selinux x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: cmake-filesystem x86_64 3.30.5-3.el10_0 appstream 15 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-19T21:01:08.176 INFO:teuthology.orchestra.run.trial105.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libcephsqlite x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 168 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-19T21:01:08.177 INFO:teuthology.orchestra.run.trial105.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libradosstriper1 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 251 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: librgw2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.7 M 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: libzstd-devel x86_64 1.5.5-9.el10 appstream 51 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-19T21:01:08.178 INFO:teuthology.orchestra.run.trial105.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: perl-Thread-Queue noarch 3.14-511.el10 appstream 21 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: perl-threads x86_64 1:2.40-511.el10 appstream 58 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: perl-threads-shared x86_64 1.69-511.el10 appstream 45 k 2026-02-19T21:01:08.179 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-private-libs x86_64 16.11-1.el10_1 appstream 143 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-argparse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 57 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-common x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 237 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-19T21:01:08.180 INFO:teuthology.orchestra.run.trial105.stdout: python3-cmd2 noarch 2.5.8-1.el10_2 epel 375 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-colorama noarch 0.4.6-13.el10 appstream 74 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-devel x86_64 3.12.12-3.el10_1 appstream 329 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-19T21:01:08.181 INFO:teuthology.orchestra.run.trial105.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-19T21:01:08.182 INFO:teuthology.orchestra.run.trial105.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyperclip noarch 1.8.2-1.el10_0 epel 28 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-19T21:01:08.183 INFO:teuthology.orchestra.run.trial105.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: uuid x86_64 1.6.2-65.el10 appstream 59 k 2026-02-19T21:01:08.184 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: zlib-ng-compat-devel x86_64 2.2.3-3.el10_1 appstream 36 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout:Installing weak dependencies: 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 22 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-daemon x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 36 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:08.185 INFO:teuthology.orchestra.run.trial105.stdout:Transaction Summary 2026-02-19T21:01:08.186 INFO:teuthology.orchestra.run.trial105.stdout:======================================================================================== 2026-02-19T21:01:08.186 INFO:teuthology.orchestra.run.trial105.stdout:Install 173 Packages 2026-02-19T21:01:08.186 INFO:teuthology.orchestra.run.trial105.stdout:Upgrade 2 Packages 2026-02-19T21:01:08.186 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:08.186 INFO:teuthology.orchestra.run.trial105.stdout:Total download size: 298 M 2026-02-19T21:01:08.187 INFO:teuthology.orchestra.run.trial105.stdout:Downloading Packages: 2026-02-19T21:01:08.192 INFO:teuthology.orchestra.run.trial090.stdout:(7/175): ceph-osd-20.3.0-5184.ga1ac97f8.el10.x8 4.1 MB/s | 176 kB 00:00 2026-02-19T21:01:08.496 INFO:teuthology.orchestra.run.trial090.stdout:(8/175): ceph-mon-20.3.0-5184.ga1ac97f8.el10.x8 16 MB/s | 6.0 MB 00:00 2026-02-19T21:01:08.517 INFO:teuthology.orchestra.run.trial105.stdout:(1/175): ceph-20.3.0-5184.ga1ac97f8.el10.x86_64 26 kB/s | 6.6 kB 00:00 2026-02-19T21:01:08.607 INFO:teuthology.orchestra.run.trial175.stdout:Package librados2-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-19T21:01:08.607 INFO:teuthology.orchestra.run.trial175.stdout:Package librbd1-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-19T21:01:08.611 INFO:teuthology.orchestra.run.trial175.stdout:Package NetworkManager-1:1.54.0-2.el10_1.x86_64 is already installed. 2026-02-19T21:01:08.612 INFO:teuthology.orchestra.run.trial175.stdout:Package iproute-6.14.0-2.el10.x86_64 is already installed. 2026-02-19T21:01:08.612 INFO:teuthology.orchestra.run.trial175.stdout:Package util-linux-2.40.2-15.el10_1.x86_64 is already installed. 2026-02-19T21:01:08.612 INFO:teuthology.orchestra.run.trial175.stdout:Package libacl-devel-2.3.2-4.el10.x86_64 is already installed. 2026-02-19T21:01:08.613 INFO:teuthology.orchestra.run.trial175.stdout:Package libattr-devel-2.5.2-5.el10.x86_64 is already installed. 2026-02-19T21:01:08.613 INFO:teuthology.orchestra.run.trial175.stdout:Package xfsdump-3.2.0-1.el10.x86_64 is already installed. 2026-02-19T21:01:08.613 INFO:teuthology.orchestra.run.trial175.stdout:Package xfsprogs-6.11.0-2.el10.x86_64 is already installed. 2026-02-19T21:01:08.632 INFO:teuthology.orchestra.run.trial175.stdout:Dependencies resolved. 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout:======================================================================================== 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout: Package Arch Version Repository Size 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout:======================================================================================== 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout:Installing: 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout: bison x86_64 3.8.2-9.el10 appstream 1.0 M 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout: ceph x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.6 k 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout: ceph-base x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 5.3 M 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout: ceph-fuse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 1.1 M 2026-02-19T21:01:08.636 INFO:teuthology.orchestra.run.trial175.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 152 k 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 985 k 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 184 k 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 15 M 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 7.4 M 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-rook noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 50 k 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-osd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 176 k 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-osd-classic x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 17 M 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-radosgw x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 14 M 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-test x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 81 M 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: ceph-volume noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 374 k 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: cephadm noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 1.3 M 2026-02-19T21:01:08.637 INFO:teuthology.orchestra.run.trial175.stdout: cephfs-mirror x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 252 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: cephfs-shell x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 27 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: cephfs-top noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 18 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: elfutils-libelf-devel x86_64 0.193-1.el10.rocky.0.1 appstream 48 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: flex x86_64 2.6.4-19.el10 appstream 300 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: libaio-devel x86_64 0.3.111-22.el10 appstream 10 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs-devel x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 37 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 937 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: librados-devel x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 128 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: libtool x86_64 2.4.7-13.el10 appstream 601 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: libuuid-devel x86_64 2.40.2-15.el10_1 appstream 37 k 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: openssl-devel x86_64 1:3.5.1-7.el10_1 appstream 3.0 M 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: postgresql x86_64 16.11-1.el10_1 appstream 2.0 M 2026-02-19T21:01:08.638 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-contrib x86_64 16.11-1.el10_1 appstream 1.0 M 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-server x86_64 16.11-1.el10_1 appstream 7.0 M 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: python3-cephfs x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 253 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: python3-rados x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 353 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: python3-rbd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 371 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: python3-rgw x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 130 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: rbd-fuse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 87 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: rbd-mirror x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.9 M 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: rbd-nbd x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 179 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: xfsprogs-devel x86_64 6.11.0-2.el10 appstream 105 k 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout:Upgrading: 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: librados2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 3.6 M 2026-02-19T21:01:08.639 INFO:teuthology.orchestra.run.trial175.stdout: librbd1 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.8 M 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout:Installing dependencies: 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: automake noarch 1.16.5-20.el10 appstream 704 k 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-common x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 M 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 57 k 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mds x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 2.4 M 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 297 k 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mon x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.0 M 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-osd-crimson x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 20 M 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 17 k 2026-02-19T21:01:08.640 INFO:teuthology.orchestra.run.trial175.stdout: ceph-selinux x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: cmake-filesystem x86_64 3.30.5-3.el10_0 appstream 15 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-19T21:01:08.641 INFO:teuthology.orchestra.run.trial175.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 25 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libcephsqlite x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 168 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-19T21:01:08.642 INFO:teuthology.orchestra.run.trial175.stdout: libradosstriper1 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 251 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: librgw2 x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 6.7 M 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: libzstd-devel x86_64 1.5.5-9.el10 appstream 51 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-19T21:01:08.643 INFO:teuthology.orchestra.run.trial175.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: perl-Thread-Queue noarch 3.14-511.el10 appstream 21 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: perl-threads x86_64 1:2.40-511.el10 appstream 58 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: perl-threads-shared x86_64 1.69-511.el10 appstream 45 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-private-libs x86_64 16.11-1.el10_1 appstream 143 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-19T21:01:08.644 INFO:teuthology.orchestra.run.trial175.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-ceph-argparse x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 57 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-ceph-common x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 237 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-cmd2 noarch 2.5.8-1.el10_2 epel 375 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-colorama noarch 0.4.6-13.el10 appstream 74 k 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-19T21:01:08.645 INFO:teuthology.orchestra.run.trial175.stdout: python3-devel x86_64 3.12.12-3.el10_1 appstream 329 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-19T21:01:08.646 INFO:teuthology.orchestra.run.trial175.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-19T21:01:08.647 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyperclip noarch 1.8.2-1.el10_0 epel 28 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-19T21:01:08.648 INFO:teuthology.orchestra.run.trial175.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: uuid x86_64 1.6.2-65.el10 appstream 59 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-19T21:01:08.649 INFO:teuthology.orchestra.run.trial175.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: zlib-ng-compat-devel x86_64 2.2.3-3.el10_1 appstream 36 k 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout:Installing weak dependencies: 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5184.ga1ac97f8.el10 ceph-noarch 22 k 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs-daemon x86_64 2:20.3.0-5184.ga1ac97f8.el10 ceph 36 k 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout:Transaction Summary 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout:======================================================================================== 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout:Install 173 Packages 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout:Upgrade 2 Packages 2026-02-19T21:01:08.650 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:08.651 INFO:teuthology.orchestra.run.trial175.stdout:Total download size: 298 M 2026-02-19T21:01:08.651 INFO:teuthology.orchestra.run.trial175.stdout:Downloading Packages: 2026-02-19T21:01:08.953 INFO:teuthology.orchestra.run.trial175.stdout:(1/175): ceph-20.3.0-5184.ga1ac97f8.el10.x86_64 28 kB/s | 6.6 kB 00:00 2026-02-19T21:01:09.056 INFO:teuthology.orchestra.run.trial090.stdout:(9/175): ceph-common-20.3.0-5184.ga1ac97f8.el10 20 MB/s | 25 MB 00:01 2026-02-19T21:01:09.083 INFO:teuthology.orchestra.run.trial090.stdout:(10/175): ceph-osd-classic-20.3.0-5184.ga1ac97f 19 MB/s | 17 MB 00:00 2026-02-19T21:01:09.133 INFO:teuthology.orchestra.run.trial090.stdout:(11/175): ceph-selinux-20.3.0-5184.ga1ac97f8.el 518 kB/s | 25 kB 00:00 2026-02-19T21:01:09.469 INFO:teuthology.orchestra.run.trial105.stdout:(2/175): ceph-fuse-20.3.0-5184.ga1ac97f8.el10.x 1.1 MB/s | 1.1 MB 00:00 2026-02-19T21:01:09.634 INFO:teuthology.orchestra.run.trial105.stdout:(3/175): ceph-immutable-object-cache-20.3.0-518 920 kB/s | 152 kB 00:00 2026-02-19T21:01:09.730 INFO:teuthology.orchestra.run.trial175.stdout:(2/175): ceph-fuse-20.3.0-5184.ga1ac97f8.el10.x 1.4 MB/s | 1.1 MB 00:00 2026-02-19T21:01:09.773 INFO:teuthology.orchestra.run.trial090.stdout:(12/175): ceph-osd-crimson-20.3.0-5184.ga1ac97f 15 MB/s | 20 MB 00:01 2026-02-19T21:01:09.826 INFO:teuthology.orchestra.run.trial090.stdout:(13/175): cephfs-mirror-20.3.0-5184.ga1ac97f8.e 4.7 MB/s | 252 kB 00:00 2026-02-19T21:01:09.827 INFO:teuthology.orchestra.run.trial175.stdout:(3/175): ceph-immutable-object-cache-20.3.0-518 1.5 MB/s | 152 kB 00:00 2026-02-19T21:01:09.869 INFO:teuthology.orchestra.run.trial090.stdout:(14/175): cephfs-shell-20.3.0-5184.ga1ac97f8.el 632 kB/s | 27 kB 00:00 2026-02-19T21:01:09.902 INFO:teuthology.orchestra.run.trial090.stdout:(15/175): ceph-radosgw-20.3.0-5184.ga1ac97f8.el 16 MB/s | 14 MB 00:00 2026-02-19T21:01:09.903 INFO:teuthology.orchestra.run.trial090.stdout:(16/175): libcephfs-daemon-20.3.0-5184.ga1ac97f 1.0 MB/s | 36 kB 00:00 2026-02-19T21:01:09.928 INFO:teuthology.orchestra.run.trial090.stdout:(17/175): libcephfs-devel-20.3.0-5184.ga1ac97f8 1.4 MB/s | 37 kB 00:00 2026-02-19T21:01:09.936 INFO:teuthology.orchestra.run.trial090.stdout:(18/175): libcephfs-proxy2-20.3.0-5184.ga1ac97f 769 kB/s | 25 kB 00:00 2026-02-19T21:01:09.984 INFO:teuthology.orchestra.run.trial090.stdout:(19/175): libcephsqlite-20.3.0-5184.ga1ac97f8.e 3.4 MB/s | 168 kB 00:00 2026-02-19T21:01:10.005 INFO:teuthology.orchestra.run.trial175.stdout:(4/175): ceph-base-20.3.0-5184.ga1ac97f8.el10.x 4.2 MB/s | 5.3 MB 00:01 2026-02-19T21:01:10.008 INFO:teuthology.orchestra.run.trial090.stdout:(20/175): libcephfs2-20.3.0-5184.ga1ac97f8.el10 11 MB/s | 937 kB 00:00 2026-02-19T21:01:10.018 INFO:teuthology.orchestra.run.trial090.stdout:(21/175): librados-devel-20.3.0-5184.ga1ac97f8. 3.7 MB/s | 128 kB 00:00 2026-02-19T21:01:10.047 INFO:teuthology.orchestra.run.trial090.stdout:(22/175): libradosstriper1-20.3.0-5184.ga1ac97f 6.4 MB/s | 251 kB 00:00 2026-02-19T21:01:10.092 INFO:teuthology.orchestra.run.trial090.stdout:(23/175): python3-ceph-argparse-20.3.0-5184.ga1 1.2 MB/s | 57 kB 00:00 2026-02-19T21:01:10.142 INFO:teuthology.orchestra.run.trial090.stdout:(24/175): python3-ceph-common-20.3.0-5184.ga1ac 4.6 MB/s | 237 kB 00:00 2026-02-19T21:01:10.180 INFO:teuthology.orchestra.run.trial175.stdout:(5/175): ceph-mgr-20.3.0-5184.ga1ac97f8.el10.x8 5.5 MB/s | 985 kB 00:00 2026-02-19T21:01:10.187 INFO:teuthology.orchestra.run.trial090.stdout:(25/175): python3-cephfs-20.3.0-5184.ga1ac97f8. 5.5 MB/s | 253 kB 00:00 2026-02-19T21:01:10.241 INFO:teuthology.orchestra.run.trial090.stdout:(26/175): python3-rados-20.3.0-5184.ga1ac97f8.e 6.5 MB/s | 353 kB 00:00 2026-02-19T21:01:10.294 INFO:teuthology.orchestra.run.trial090.stdout:(27/175): python3-rbd-20.3.0-5184.ga1ac97f8.el1 6.8 MB/s | 371 kB 00:00 2026-02-19T21:01:10.344 INFO:teuthology.orchestra.run.trial090.stdout:(28/175): python3-rgw-20.3.0-5184.ga1ac97f8.el1 2.6 MB/s | 130 kB 00:00 2026-02-19T21:01:10.393 INFO:teuthology.orchestra.run.trial090.stdout:(29/175): rbd-fuse-20.3.0-5184.ga1ac97f8.el10.x 1.7 MB/s | 87 kB 00:00 2026-02-19T21:01:10.460 INFO:teuthology.orchestra.run.trial175.stdout:(6/175): ceph-mds-20.3.0-5184.ga1ac97f8.el10.x8 3.9 MB/s | 2.4 MB 00:00 2026-02-19T21:01:10.476 INFO:teuthology.orchestra.run.trial090.stdout:(30/175): librgw2-20.3.0-5184.ga1ac97f8.el10.x8 15 MB/s | 6.7 MB 00:00 2026-02-19T21:01:10.517 INFO:teuthology.orchestra.run.trial175.stdout:(7/175): ceph-osd-20.3.0-5184.ga1ac97f8.el10.x8 3.0 MB/s | 176 kB 00:00 2026-02-19T21:01:10.529 INFO:teuthology.orchestra.run.trial090.stdout:(31/175): rbd-nbd-20.3.0-5184.ga1ac97f8.el10.x8 3.3 MB/s | 179 kB 00:00 2026-02-19T21:01:10.581 INFO:teuthology.orchestra.run.trial090.stdout:(32/175): ceph-grafana-dashboards-20.3.0-5184.g 1.1 MB/s | 57 kB 00:00 2026-02-19T21:01:10.611 INFO:teuthology.orchestra.run.trial090.stdout:(33/175): rbd-mirror-20.3.0-5184.ga1ac97f8.el10 13 MB/s | 2.9 MB 00:00 2026-02-19T21:01:10.627 INFO:teuthology.orchestra.run.trial090.stdout:(34/175): ceph-mgr-cephadm-20.3.0-5184.ga1ac97f 3.9 MB/s | 184 kB 00:00 2026-02-19T21:01:11.245 INFO:teuthology.orchestra.run.trial175.stdout:(8/175): ceph-mon-20.3.0-5184.ga1ac97f8.el10.x8 5.7 MB/s | 6.0 MB 00:01 2026-02-19T21:01:11.295 INFO:teuthology.orchestra.run.trial090.stdout:(35/175): ceph-mgr-diskprediction-local-20.3.0- 11 MB/s | 7.4 MB 00:00 2026-02-19T21:01:11.304 INFO:teuthology.orchestra.run.trial105.stdout:(4/175): ceph-mds-20.3.0-5184.ga1ac97f8.el10.x8 1.5 MB/s | 2.4 MB 00:01 2026-02-19T21:01:11.353 INFO:teuthology.orchestra.run.trial090.stdout:(36/175): ceph-mgr-k8sevents-20.3.0-5184.ga1ac9 383 kB/s | 22 kB 00:00 2026-02-19T21:01:11.417 INFO:teuthology.orchestra.run.trial090.stdout:(37/175): ceph-mgr-modules-core-20.3.0-5184.ga1 4.6 MB/s | 297 kB 00:00 2026-02-19T21:01:11.477 INFO:teuthology.orchestra.run.trial090.stdout:(38/175): ceph-mgr-rook-20.3.0-5184.ga1ac97f8.e 845 kB/s | 50 kB 00:00 2026-02-19T21:01:11.537 INFO:teuthology.orchestra.run.trial090.stdout:(39/175): ceph-prometheus-alerts-20.3.0-5184.ga 294 kB/s | 17 kB 00:00 2026-02-19T21:01:11.603 INFO:teuthology.orchestra.run.trial090.stdout:(40/175): ceph-volume-20.3.0-5184.ga1ac97f8.el1 5.5 MB/s | 374 kB 00:00 2026-02-19T21:01:11.770 INFO:teuthology.orchestra.run.trial090.stdout:(41/175): ceph-mgr-dashboard-20.3.0-5184.ga1ac9 13 MB/s | 15 MB 00:01 2026-02-19T21:01:11.784 INFO:teuthology.orchestra.run.trial090.stdout:(42/175): cephadm-20.3.0-5184.ga1ac97f8.el10.no 7.4 MB/s | 1.3 MB 00:00 2026-02-19T21:01:11.811 INFO:teuthology.orchestra.run.trial090.stdout:(43/175): cephfs-top-20.3.0-5184.ga1ac97f8.el10 445 kB/s | 18 kB 00:00 2026-02-19T21:01:11.831 INFO:teuthology.orchestra.run.trial090.stdout:(44/175): automake-1.16.5-20.el10.noarch.rpm 15 MB/s | 704 kB 00:00 2026-02-19T21:01:11.839 INFO:teuthology.orchestra.run.trial090.stdout:(45/175): bison-3.8.2-9.el10.x86_64.rpm 35 MB/s | 1.0 MB 00:00 2026-02-19T21:01:11.853 INFO:teuthology.orchestra.run.trial090.stdout:(46/175): cmake-filesystem-3.30.5-3.el10_0.x86_ 1.1 MB/s | 15 kB 00:00 2026-02-19T21:01:11.855 INFO:teuthology.orchestra.run.trial090.stdout:(47/175): boost-program-options-1.83.0-5.el10.x 4.4 MB/s | 109 kB 00:00 2026-02-19T21:01:11.869 INFO:teuthology.orchestra.run.trial090.stdout:(48/175): elfutils-libelf-devel-0.193-1.el10.ro 3.0 MB/s | 48 kB 00:00 2026-02-19T21:01:11.877 INFO:teuthology.orchestra.run.trial090.stdout:(49/175): flex-2.6.4-19.el10.x86_64.rpm 14 MB/s | 300 kB 00:00 2026-02-19T21:01:11.883 INFO:teuthology.orchestra.run.trial090.stdout:(50/175): flexiblas-3.4.2-3.el10.x86_64.rpm 1.7 MB/s | 25 kB 00:00 2026-02-19T21:01:11.902 INFO:teuthology.orchestra.run.trial090.stdout:(51/175): flexiblas-openblas-openmp-3.4.2-3.el1 895 kB/s | 17 kB 00:00 2026-02-19T21:01:11.916 INFO:teuthology.orchestra.run.trial090.stdout:(52/175): ledmon-libs-1.1.0-2.el10.x86_64.rpm 3.0 MB/s | 42 kB 00:00 2026-02-19T21:01:11.931 INFO:teuthology.orchestra.run.trial090.stdout:(53/175): flexiblas-netlib-3.4.2-3.el10.x86_64. 59 MB/s | 3.2 MB 00:00 2026-02-19T21:01:11.932 INFO:teuthology.orchestra.run.trial090.stdout:(54/175): libaio-devel-0.3.111-22.el10.x86_64.r 643 kB/s | 10 kB 00:00 2026-02-19T21:01:11.949 INFO:teuthology.orchestra.run.trial090.stdout:(55/175): libnbd-1.22.2-3.el10_1.x86_64.rpm 10 MB/s | 175 kB 00:00 2026-02-19T21:01:11.952 INFO:teuthology.orchestra.run.trial090.stdout:(56/175): librabbitmq-0.14.0-3.el10.x86_64.rpm 2.1 MB/s | 43 kB 00:00 2026-02-19T21:01:11.969 INFO:teuthology.orchestra.run.trial090.stdout:(57/175): libstoragemgmt-1.10.1-4.el10.x86_64.r 15 MB/s | 251 kB 00:00 2026-02-19T21:01:11.970 INFO:teuthology.orchestra.run.trial090.stdout:(58/175): librdkafka-2.1.1-7.el10.x86_64.rpm 33 MB/s | 725 kB 00:00 2026-02-19T21:01:11.984 INFO:teuthology.orchestra.run.trial105.stdout:(5/175): ceph-mgr-20.3.0-5184.ga1ac97f8.el10.x8 1.4 MB/s | 985 kB 00:00 2026-02-19T21:01:11.985 INFO:teuthology.orchestra.run.trial090.stdout:(59/175): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 2.3 MB/s | 36 kB 00:00 2026-02-19T21:01:11.992 INFO:teuthology.orchestra.run.trial090.stdout:(60/175): libtool-2.4.7-13.el10.x86_64.rpm 26 MB/s | 601 kB 00:00 2026-02-19T21:01:12.000 INFO:teuthology.orchestra.run.trial090.stdout:(61/175): libuuid-devel-2.40.2-15.el10_1.x86_64 2.6 MB/s | 37 kB 00:00 2026-02-19T21:01:12.009 INFO:teuthology.orchestra.run.trial090.stdout:(62/175): libxslt-1.1.39-8.el10_0.x86_64.rpm 11 MB/s | 189 kB 00:00 2026-02-19T21:01:12.013 INFO:teuthology.orchestra.run.trial090.stdout:(63/175): libzstd-devel-1.5.5-9.el10.x86_64.rpm 3.6 MB/s | 51 kB 00:00 2026-02-19T21:01:12.027 INFO:teuthology.orchestra.run.trial090.stdout:(64/175): openblas-0.3.29-2.el10.x86_64.rpm 3.1 MB/s | 43 kB 00:00 2026-02-19T21:01:12.028 INFO:teuthology.orchestra.run.trial090.stdout:(65/175): lua-5.4.6-7.el10.x86_64.rpm 9.8 MB/s | 190 kB 00:00 2026-02-19T21:01:12.079 INFO:teuthology.orchestra.run.trial090.stdout:(66/175): openssl-devel-3.5.1-7.el10_1.x86_64.r 60 MB/s | 3.0 MB 00:00 2026-02-19T21:01:12.094 INFO:teuthology.orchestra.run.trial090.stdout:(67/175): perl-Thread-Queue-3.14-511.el10.noarc 1.4 MB/s | 21 kB 00:00 2026-02-19T21:01:12.109 INFO:teuthology.orchestra.run.trial090.stdout:(68/175): perl-threads-2.40-511.el10.x86_64.rpm 3.7 MB/s | 58 kB 00:00 2026-02-19T21:01:12.123 INFO:teuthology.orchestra.run.trial090.stdout:(69/175): perl-threads-shared-1.69-511.el10.x86 3.2 MB/s | 45 kB 00:00 2026-02-19T21:01:12.165 INFO:teuthology.orchestra.run.trial090.stdout:(70/175): postgresql-16.11-1.el10_1.x86_64.rpm 47 MB/s | 2.0 MB 00:00 2026-02-19T21:01:12.191 INFO:teuthology.orchestra.run.trial090.stdout:(71/175): postgresql-contrib-16.11-1.el10_1.x86 40 MB/s | 1.0 MB 00:00 2026-02-19T21:01:12.208 INFO:teuthology.orchestra.run.trial105.stdout:(6/175): ceph-base-20.3.0-5184.ga1ac97f8.el10.x 1.4 MB/s | 5.3 MB 00:03 2026-02-19T21:01:12.221 INFO:teuthology.orchestra.run.trial090.stdout:(72/175): postgresql-private-libs-16.11-1.el10_ 4.6 MB/s | 143 kB 00:00 2026-02-19T21:01:12.292 INFO:teuthology.orchestra.run.trial105.stdout:(7/175): ceph-osd-20.3.0-5184.ga1ac97f8.el10.x8 2.1 MB/s | 176 kB 00:00 2026-02-19T21:01:12.320 INFO:teuthology.orchestra.run.trial090.stdout:(73/175): postgresql-server-16.11-1.el10_1.x86_ 70 MB/s | 7.0 MB 00:00 2026-02-19T21:01:12.346 INFO:teuthology.orchestra.run.trial090.stdout:(74/175): protobuf-3.19.6-11.el10.x86_64.rpm 40 MB/s | 1.0 MB 00:00 2026-02-19T21:01:12.363 INFO:teuthology.orchestra.run.trial090.stdout:(75/175): python3-colorama-0.4.6-13.el10.noarch 4.4 MB/s | 74 kB 00:00 2026-02-19T21:01:12.379 INFO:teuthology.orchestra.run.trial090.stdout:(76/175): python3-devel-3.12.12-3.el10_1.x86_64 20 MB/s | 329 kB 00:00 2026-02-19T21:01:12.396 INFO:teuthology.orchestra.run.trial090.stdout:(77/175): python3-jinja2-3.1.6-1.el10_0.noarch. 19 MB/s | 330 kB 00:00 2026-02-19T21:01:12.409 INFO:teuthology.orchestra.run.trial090.stdout:(78/175): python3-jmespath-1.0.1-8.el10.noarch. 4.6 MB/s | 60 kB 00:00 2026-02-19T21:01:12.419 INFO:teuthology.orchestra.run.trial175.stdout:(9/175): ceph-common-20.3.0-5184.ga1ac97f8.el10 6.7 MB/s | 25 MB 00:03 2026-02-19T21:01:12.426 INFO:teuthology.orchestra.run.trial090.stdout:(79/175): python3-libstoragemgmt-1.10.1-4.el10. 13 MB/s | 219 kB 00:00 2026-02-19T21:01:12.457 INFO:teuthology.orchestra.run.trial090.stdout:(80/175): python3-lxml-5.2.1-4.el10.x86_64.rpm 44 MB/s | 1.4 MB 00:00 2026-02-19T21:01:12.470 INFO:teuthology.orchestra.run.trial090.stdout:(81/175): python3-markupsafe-2.1.3-6.el10.x86_6 2.6 MB/s | 34 kB 00:00 2026-02-19T21:01:12.574 INFO:teuthology.orchestra.run.trial090.stdout:(82/175): python3-numpy-1.26.4-5.el10.x86_64.rp 64 MB/s | 6.7 MB 00:00 2026-02-19T21:01:12.580 INFO:teuthology.orchestra.run.trial090.stdout:(83/175): openblas-openmp-0.3.29-2.el10.x86_64. 9.6 MB/s | 5.3 MB 00:00 2026-02-19T21:01:12.594 INFO:teuthology.orchestra.run.trial175.stdout:(10/175): ceph-osd-classic-20.3.0-5184.ga1ac97f 8.2 MB/s | 17 MB 00:02 2026-02-19T21:01:12.596 INFO:teuthology.orchestra.run.trial090.stdout:(84/175): python3-numpy-f2py-1.26.4-5.el10.x86_ 22 MB/s | 490 kB 00:00 2026-02-19T21:01:12.597 INFO:teuthology.orchestra.run.trial090.stdout:(85/175): python3-prettytable-3.6.0-10.el10.noa 4.1 MB/s | 70 kB 00:00 2026-02-19T21:01:12.613 INFO:teuthology.orchestra.run.trial090.stdout:(86/175): python3-pyasn1-0.6.1-1.el10.noarch.rp 12 MB/s | 198 kB 00:00 2026-02-19T21:01:12.619 INFO:teuthology.orchestra.run.trial090.stdout:(87/175): python3-protobuf-3.19.6-11.el10.x86_6 19 MB/s | 419 kB 00:00 2026-02-19T21:01:12.620 INFO:teuthology.orchestra.run.trial175.stdout:(11/175): ceph-selinux-20.3.0-5184.ga1ac97f8.el 965 kB/s | 25 kB 00:00 2026-02-19T21:01:12.632 INFO:teuthology.orchestra.run.trial090.stdout:(88/175): python3-requests-oauthlib-1.3.1-11.el 4.5 MB/s | 60 kB 00:00 2026-02-19T21:01:12.636 INFO:teuthology.orchestra.run.trial090.stdout:(89/175): python3-pyasn1-modules-0.6.1-1.el10.n 18 MB/s | 402 kB 00:00 2026-02-19T21:01:12.652 INFO:teuthology.orchestra.run.trial090.stdout:(90/175): qatlib-24.09.0-2.el10.x86_64.rpm 14 MB/s | 229 kB 00:00 2026-02-19T21:01:12.668 INFO:teuthology.orchestra.run.trial090.stdout:(91/175): qatlib-service-24.09.0-2.el10.x86_64. 2.3 MB/s | 37 kB 00:00 2026-02-19T21:01:12.684 INFO:teuthology.orchestra.run.trial090.stdout:(92/175): qatzip-libs-1.3.1-1.el10.x86_64.rpm 4.1 MB/s | 66 kB 00:00 2026-02-19T21:01:12.704 INFO:teuthology.orchestra.run.trial090.stdout:(93/175): socat-1.7.4.4-8.el10.x86_64.rpm 15 MB/s | 303 kB 00:00 2026-02-19T21:01:12.721 INFO:teuthology.orchestra.run.trial090.stdout:(94/175): utf8proc-2.7.0-9.el10.x86_64.rpm 4.5 MB/s | 80 kB 00:00 2026-02-19T21:01:12.734 INFO:teuthology.orchestra.run.trial090.stdout:(95/175): uuid-1.6.2-65.el10.x86_64.rpm 4.6 MB/s | 59 kB 00:00 2026-02-19T21:01:12.752 INFO:teuthology.orchestra.run.trial090.stdout:(96/175): xfsprogs-devel-6.11.0-2.el10.x86_64.r 5.6 MB/s | 105 kB 00:00 2026-02-19T21:01:12.771 INFO:teuthology.orchestra.run.trial090.stdout:(97/175): xmlsec1-1.2.39-3.el10.x86_64.rpm 10 MB/s | 193 kB 00:00 2026-02-19T21:01:12.794 INFO:teuthology.orchestra.run.trial090.stdout:(98/175): xmlsec1-openssl-1.2.39-3.el10.x86_64. 4.0 MB/s | 96 kB 00:00 2026-02-19T21:01:12.808 INFO:teuthology.orchestra.run.trial090.stdout:(99/175): xmlstarlet-1.6.1-27.el10.x86_64.rpm 4.4 MB/s | 63 kB 00:00 2026-02-19T21:01:12.822 INFO:teuthology.orchestra.run.trial090.stdout:(100/175): zlib-ng-compat-devel-2.2.3-3.el10_1. 2.6 MB/s | 36 kB 00:00 2026-02-19T21:01:12.841 INFO:teuthology.orchestra.run.trial090.stdout:(101/175): cryptsetup-2.7.5-2.el10.x86_64.rpm 17 MB/s | 335 kB 00:00 2026-02-19T21:01:12.866 INFO:teuthology.orchestra.run.trial090.stdout:(102/175): python3-scipy-1.11.3-17.el10.x86_64. 69 MB/s | 16 MB 00:00 2026-02-19T21:01:12.866 INFO:teuthology.orchestra.run.trial090.stdout:(103/175): daxctl-libs-80-4.el10.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-19T21:01:12.879 INFO:teuthology.orchestra.run.trial090.stdout:(104/175): fuse3-3.16.2-5.el10.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2026-02-19T21:01:12.896 INFO:teuthology.orchestra.run.trial090.stdout:(105/175): libconfig-1.7.3-10.el10.x86_64.rpm 4.3 MB/s | 72 kB 00:00 2026-02-19T21:01:12.906 INFO:teuthology.orchestra.run.trial090.stdout:(106/175): hwloc-libs-2.11.1-3.el10.x86_64.rpm 54 MB/s | 2.1 MB 00:00 2026-02-19T21:01:12.918 INFO:teuthology.orchestra.run.trial090.stdout:(107/175): libpciaccess-0.16-16.el10.x86_64.rpm 2.2 MB/s | 27 kB 00:00 2026-02-19T21:01:12.921 INFO:teuthology.orchestra.run.trial090.stdout:(108/175): libgfortran-14.3.1-2.1.el10.x86_64.r 33 MB/s | 827 kB 00:00 2026-02-19T21:01:12.933 INFO:teuthology.orchestra.run.trial090.stdout:(109/175): mailcap-2.1.54-8.el10.noarch.rpm 2.7 MB/s | 34 kB 00:00 2026-02-19T21:01:12.952 INFO:teuthology.orchestra.run.trial090.stdout:(110/175): libquadmath-14.3.1-2.1.el10.x86_64.r 6.2 MB/s | 215 kB 00:00 2026-02-19T21:01:12.956 INFO:teuthology.orchestra.run.trial090.stdout:(111/175): ndctl-libs-80-4.el10.x86_64.rpm 3.8 MB/s | 89 kB 00:00 2026-02-19T21:01:12.969 INFO:teuthology.orchestra.run.trial090.stdout:(112/175): ocl-icd-2.3.2-8.el10.x86_64.rpm 4.0 MB/s | 66 kB 00:00 2026-02-19T21:01:12.971 INFO:teuthology.orchestra.run.trial090.stdout:(113/175): pciutils-3.13.0-6.el10.x86_64.rpm 7.9 MB/s | 122 kB 00:00 2026-02-19T21:01:12.989 INFO:teuthology.orchestra.run.trial090.stdout:(114/175): python3-cffi-1.16.0-7.el10.x86_64.rp 15 MB/s | 310 kB 00:00 2026-02-19T21:01:13.000 INFO:teuthology.orchestra.run.trial090.stdout:(115/175): python3-cryptography-43.0.0-4.el10.x 48 MB/s | 1.3 MB 00:00 2026-02-19T21:01:13.006 INFO:teuthology.orchestra.run.trial090.stdout:(116/175): python3-packaging-24.2-2.el10.noarch 9.1 MB/s | 155 kB 00:00 2026-02-19T21:01:13.017 INFO:teuthology.orchestra.run.trial090.stdout:(117/175): python3-ply-3.11-25.el10.noarch.rpm 7.7 MB/s | 137 kB 00:00 2026-02-19T21:01:13.022 INFO:teuthology.orchestra.run.trial090.stdout:(118/175): python3-pycparser-2.20-16.el10.noarc 9.4 MB/s | 160 kB 00:00 2026-02-19T21:01:13.039 INFO:teuthology.orchestra.run.trial090.stdout:(119/175): python3-requests-2.32.4-1.el10_0.noa 7.4 MB/s | 160 kB 00:00 2026-02-19T21:01:13.040 INFO:teuthology.orchestra.run.trial090.stdout:(120/175): python3-urllib3-1.26.19-2.el10_1.1.n 16 MB/s | 285 kB 00:00 2026-02-19T21:01:13.055 INFO:teuthology.orchestra.run.trial090.stdout:(121/175): unzip-6.0-69.el10.x86_64.rpm 11 MB/s | 188 kB 00:00 2026-02-19T21:01:13.057 INFO:teuthology.orchestra.run.trial090.stdout:(122/175): zip-3.0-45.el10.x86_64.rpm 16 MB/s | 271 kB 00:00 2026-02-19T21:01:13.072 INFO:teuthology.orchestra.run.trial090.stdout:(123/175): lua-devel-5.4.6-7.el10.x86_64.rpm 1.5 MB/s | 22 kB 00:00 2026-02-19T21:01:13.075 INFO:teuthology.orchestra.run.trial090.stdout:(124/175): lttng-ust-2.13.7-5.el10.x86_64.rpm 16 MB/s | 334 kB 00:00 2026-02-19T21:01:13.107 INFO:teuthology.orchestra.run.trial090.stdout:(125/175): abseil-cpp-20240722.1-1.el10_0.x86_6 18 MB/s | 590 kB 00:00 2026-02-19T21:01:13.116 INFO:teuthology.orchestra.run.trial090.stdout:(126/175): gperftools-libs-2.15-4.el10_0.x86_64 36 MB/s | 303 kB 00:00 2026-02-19T21:01:13.121 INFO:teuthology.orchestra.run.trial090.stdout:(127/175): grpc-data-1.48.4-44.el10_0.noarch.rp 4.1 MB/s | 21 kB 00:00 2026-02-19T21:01:13.152 INFO:teuthology.orchestra.run.trial090.stdout:(128/175): libarrow-17.0.0-9.el10_2.x86_64.rpm 184 MB/s | 5.7 MB 00:00 2026-02-19T21:01:13.155 INFO:teuthology.orchestra.run.trial090.stdout:(129/175): protobuf-compiler-3.19.6-11.el10.x86 9.3 MB/s | 787 kB 00:00 2026-02-19T21:01:13.157 INFO:teuthology.orchestra.run.trial090.stdout:(130/175): libarrow-doc-17.0.0-9.el10_2.noarch. 5.1 MB/s | 27 kB 00:00 2026-02-19T21:01:13.165 INFO:teuthology.orchestra.run.trial090.stdout:(131/175): liborc2-2.0.7-1.el10_2.x86_64.rpm 65 MB/s | 515 kB 00:00 2026-02-19T21:01:13.172 INFO:teuthology.orchestra.run.trial090.stdout:(132/175): libpmem-2.1.0-2.el10_0.x86_64.rpm 16 MB/s | 112 kB 00:00 2026-02-19T21:01:13.172 INFO:teuthology.orchestra.run.trial090.stdout:(133/175): liboath-2.6.12-1.el10_0.x86_64.rpm 2.7 MB/s | 48 kB 00:00 2026-02-19T21:01:13.195 INFO:teuthology.orchestra.run.trial090.stdout:(134/175): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 6.9 MB/s | 161 kB 00:00 2026-02-19T21:01:13.201 INFO:teuthology.orchestra.run.trial090.stdout:(135/175): libunwind-1.8.0-4.el10_0.x86_64.rpm 2.5 MB/s | 73 kB 00:00 2026-02-19T21:01:13.203 INFO:teuthology.orchestra.run.trial090.stdout:(136/175): luarocks-3.9.2-6.el10_0.noarch.rpm 18 MB/s | 152 kB 00:00 2026-02-19T21:01:13.216 INFO:teuthology.orchestra.run.trial090.stdout:(137/175): python3-asyncssh-2.17.0-1.el10_0.noa 59 MB/s | 756 kB 00:00 2026-02-19T21:01:13.222 INFO:teuthology.orchestra.run.trial090.stdout:(138/175): parquet-libs-17.0.0-9.el10_2.x86_64. 47 MB/s | 1.0 MB 00:00 2026-02-19T21:01:13.223 INFO:teuthology.orchestra.run.trial090.stdout:(139/175): python3-autocommand-2.2.2-9.el10_0.n 4.7 MB/s | 32 kB 00:00 2026-02-19T21:01:13.229 INFO:teuthology.orchestra.run.trial090.stdout:(140/175): python3-cachetools-5.4.0-6.el10_0.no 5.7 MB/s | 37 kB 00:00 2026-02-19T21:01:13.234 INFO:teuthology.orchestra.run.trial090.stdout:(141/175): python3-certifi-2023.05.07-6.el10_0. 2.6 MB/s | 14 kB 00:00 2026-02-19T21:01:13.242 INFO:teuthology.orchestra.run.trial090.stdout:(142/175): python3-cheroot-10.0.1-4.el10_0.noar 28 MB/s | 215 kB 00:00 2026-02-19T21:01:13.251 INFO:teuthology.orchestra.run.trial090.stdout:(143/175): python3-cherrypy-18.10.0-4.el10_0.no 40 MB/s | 359 kB 00:00 2026-02-19T21:01:13.259 INFO:teuthology.orchestra.run.trial090.stdout:(144/175): python3-cmd2-2.5.8-1.el10_2.noarch.r 43 MB/s | 375 kB 00:00 2026-02-19T21:01:13.265 INFO:teuthology.orchestra.run.trial090.stdout:(145/175): python3-durationpy-0.9-2.el10_0.noar 2.6 MB/s | 15 kB 00:00 2026-02-19T21:01:13.274 INFO:teuthology.orchestra.run.trial090.stdout:(146/175): python3-google-auth-2.40.3-1.el10_1. 33 MB/s | 286 kB 00:00 2026-02-19T21:01:13.279 INFO:teuthology.orchestra.run.trial090.stdout:(147/175): python3-bcrypt-4.3.0-3.el10_1.x86_64 4.1 MB/s | 238 kB 00:00 2026-02-19T21:01:13.287 INFO:teuthology.orchestra.run.trial090.stdout:(148/175): python3-grpcio-tools-1.48.4-44.el10_ 19 MB/s | 157 kB 00:00 2026-02-19T21:01:13.291 INFO:teuthology.orchestra.run.trial090.stdout:(149/175): python3-grpcio-1.48.4-44.el10_0.x86_ 135 MB/s | 2.3 MB 00:00 2026-02-19T21:01:13.294 INFO:teuthology.orchestra.run.trial090.stdout:(150/175): python3-isodate-0.6.1-14.el10_0.noar 10 MB/s | 66 kB 00:00 2026-02-19T21:01:13.297 INFO:teuthology.orchestra.run.trial090.stdout:(151/175): python3-jaraco-collections-5.1.0-1.e 4.9 MB/s | 29 kB 00:00 2026-02-19T21:01:13.299 INFO:teuthology.orchestra.run.trial090.stdout:(152/175): python3-jaraco-context-6.0.1-4.el10_ 3.8 MB/s | 21 kB 00:00 2026-02-19T21:01:13.302 INFO:teuthology.orchestra.run.trial090.stdout:(153/175): python3-jaraco-functools-4.0.2-4.el1 4.2 MB/s | 23 kB 00:00 2026-02-19T21:01:13.305 INFO:teuthology.orchestra.run.trial090.stdout:(154/175): python3-jaraco-text-4.0.0-3.el10_0.n 5.2 MB/s | 29 kB 00:00 2026-02-19T21:01:13.313 INFO:teuthology.orchestra.run.trial090.stdout:(155/175): python3-kubernetes-32.0.1-1.el10_1.n 127 MB/s | 1.3 MB 00:00 2026-02-19T21:01:13.313 INFO:teuthology.orchestra.run.trial090.stdout:(156/175): python3-more-itertools-10.1.0-8.el10 12 MB/s | 100 kB 00:00 2026-02-19T21:01:13.319 INFO:teuthology.orchestra.run.trial090.stdout:(157/175): python3-portend-3.2.0-6.el10_0.noarc 3.2 MB/s | 18 kB 00:00 2026-02-19T21:01:13.319 INFO:teuthology.orchestra.run.trial090.stdout:(158/175): python3-natsort-8.4.0-2.el10_0.noarc 11 MB/s | 72 kB 00:00 2026-02-19T21:01:13.325 INFO:teuthology.orchestra.run.trial090.stdout:(159/175): python3-pyperclip-1.8.2-1.el10_0.noa 4.6 MB/s | 28 kB 00:00 2026-02-19T21:01:13.326 INFO:teuthology.orchestra.run.trial090.stdout:(160/175): python3-pyOpenSSL-25.0.0-1.el10_1.no 16 MB/s | 113 kB 00:00 2026-02-19T21:01:13.331 INFO:teuthology.orchestra.run.trial090.stdout:(161/175): python3-repoze-lru-0.7-23.el10_0.noa 6.0 MB/s | 36 kB 00:00 2026-02-19T21:01:13.334 INFO:teuthology.orchestra.run.trial090.stdout:(162/175): python3-routes-2.5.1-11.el10_0.noarc 25 MB/s | 201 kB 00:00 2026-02-19T21:01:13.338 INFO:teuthology.orchestra.run.trial090.stdout:(163/175): python3-rsa-4.9-7.el10_0.noarch.rpm 10 MB/s | 70 kB 00:00 2026-02-19T21:01:13.340 INFO:teuthology.orchestra.run.trial090.stdout:(164/175): python3-tempora-5.7.0-1.el10_0.noarc 5.6 MB/s | 37 kB 00:00 2026-02-19T21:01:13.346 INFO:teuthology.orchestra.run.trial090.stdout:(165/175): python3-xmltodict-0.13.0-5.el10_0.no 4.6 MB/s | 26 kB 00:00 2026-02-19T21:01:13.351 INFO:teuthology.orchestra.run.trial090.stdout:(166/175): python3-zc-lockfile-3.0.post1-11.el1 4.2 MB/s | 23 kB 00:00 2026-02-19T21:01:13.354 INFO:teuthology.orchestra.run.trial090.stdout:(167/175): python3-websocket-client-1.8.0-2.el1 7.7 MB/s | 124 kB 00:00 2026-02-19T21:01:13.366 INFO:teuthology.orchestra.run.trial090.stdout:(168/175): thrift-0.20.0-4.el10_1.x86_64.rpm 144 MB/s | 1.7 MB 00:00 2026-02-19T21:01:13.371 INFO:teuthology.orchestra.run.trial090.stdout:(169/175): re2-20251105-1.el10_2.x86_64.rpm 11 MB/s | 221 kB 00:00 2026-02-19T21:01:13.373 INFO:teuthology.orchestra.run.trial090.stdout:(170/175): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rp 17 MB/s | 127 kB 00:00 2026-02-19T21:01:13.377 INFO:teuthology.orchestra.run.trial090.stdout:(171/175): python3-saml-1.16.0-11.el10.noarch.r 27 MB/s | 150 kB 00:00 2026-02-19T21:01:13.378 INFO:teuthology.orchestra.run.trial090.stdout:(172/175): python3-xmlsec-1.3.16-1.el10.x86_64. 11 MB/s | 49 kB 00:00 2026-02-19T21:01:13.534 INFO:teuthology.orchestra.run.trial175.stdout:(12/175): ceph-radosgw-20.3.0-5184.ga1ac97f8.el 12 MB/s | 14 MB 00:01 2026-02-19T21:01:13.579 INFO:teuthology.orchestra.run.trial175.stdout:(13/175): cephfs-mirror-20.3.0-5184.ga1ac97f8.e 5.5 MB/s | 252 kB 00:00 2026-02-19T21:01:13.612 INFO:teuthology.orchestra.run.trial175.stdout:(14/175): cephfs-shell-20.3.0-5184.ga1ac97f8.el 839 kB/s | 27 kB 00:00 2026-02-19T21:01:13.647 INFO:teuthology.orchestra.run.trial175.stdout:(15/175): libcephfs-daemon-20.3.0-5184.ga1ac97f 1.0 MB/s | 36 kB 00:00 2026-02-19T21:01:13.668 INFO:teuthology.orchestra.run.trial175.stdout:(16/175): libcephfs-devel-20.3.0-5184.ga1ac97f8 1.7 MB/s | 37 kB 00:00 2026-02-19T21:01:13.699 INFO:teuthology.orchestra.run.trial175.stdout:(17/175): libcephfs-proxy2-20.3.0-5184.ga1ac97f 825 kB/s | 25 kB 00:00 2026-02-19T21:01:13.716 INFO:teuthology.orchestra.run.trial090.stdout:(173/175): ceph-test-20.3.0-5184.ga1ac97f8.el10 18 MB/s | 81 MB 00:04 2026-02-19T21:01:13.788 INFO:teuthology.orchestra.run.trial175.stdout:(18/175): libcephfs2-20.3.0-5184.ga1ac97f8.el10 10 MB/s | 937 kB 00:00 2026-02-19T21:01:13.833 INFO:teuthology.orchestra.run.trial175.stdout:(19/175): libcephsqlite-20.3.0-5184.ga1ac97f8.e 3.6 MB/s | 168 kB 00:00 2026-02-19T21:01:13.851 INFO:teuthology.orchestra.run.trial090.stdout:(174/175): librbd1-20.3.0-5184.ga1ac97f8.el10.x 6.0 MB/s | 2.8 MB 00:00 2026-02-19T21:01:13.866 INFO:teuthology.orchestra.run.trial175.stdout:(20/175): librados-devel-20.3.0-5184.ga1ac97f8. 3.8 MB/s | 128 kB 00:00 2026-02-19T21:01:13.879 INFO:teuthology.orchestra.run.trial090.stdout:(175/175): librados2-20.3.0-5184.ga1ac97f8.el10 7.2 MB/s | 3.6 MB 00:00 2026-02-19T21:01:13.880 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:01:13.881 INFO:teuthology.orchestra.run.trial090.stdout:Total 48 MB/s | 298 MB 00:06 2026-02-19T21:01:13.881 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction check 2026-02-19T21:01:13.899 INFO:teuthology.orchestra.run.trial175.stdout:(21/175): libradosstriper1-20.3.0-5184.ga1ac97f 7.6 MB/s | 251 kB 00:00 2026-02-19T21:01:13.944 INFO:teuthology.orchestra.run.trial090.stdout:Transaction check succeeded. 2026-02-19T21:01:13.944 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction test 2026-02-19T21:01:14.131 INFO:teuthology.orchestra.run.trial175.stdout:(22/175): ceph-osd-crimson-20.3.0-5184.ga1ac97f 6.9 MB/s | 20 MB 00:02 2026-02-19T21:01:14.160 INFO:teuthology.orchestra.run.trial175.stdout:(23/175): python3-ceph-argparse-20.3.0-5184.ga1 1.9 MB/s | 57 kB 00:00 2026-02-19T21:01:14.191 INFO:teuthology.orchestra.run.trial175.stdout:(24/175): python3-ceph-common-20.3.0-5184.ga1ac 7.6 MB/s | 237 kB 00:00 2026-02-19T21:01:14.222 INFO:teuthology.orchestra.run.trial175.stdout:(25/175): python3-cephfs-20.3.0-5184.ga1ac97f8. 7.9 MB/s | 253 kB 00:00 2026-02-19T21:01:14.263 INFO:teuthology.orchestra.run.trial175.stdout:(26/175): librgw2-20.3.0-5184.ga1ac97f8.el10.x8 18 MB/s | 6.7 MB 00:00 2026-02-19T21:01:14.271 INFO:teuthology.orchestra.run.trial175.stdout:(27/175): python3-rados-20.3.0-5184.ga1ac97f8.e 7.0 MB/s | 353 kB 00:00 2026-02-19T21:01:14.290 INFO:teuthology.orchestra.run.trial175.stdout:(28/175): python3-rbd-20.3.0-5184.ga1ac97f8.el1 14 MB/s | 371 kB 00:00 2026-02-19T21:01:14.296 INFO:teuthology.orchestra.run.trial175.stdout:(29/175): python3-rgw-20.3.0-5184.ga1ac97f8.el1 5.2 MB/s | 130 kB 00:00 2026-02-19T21:01:14.310 INFO:teuthology.orchestra.run.trial175.stdout:(30/175): rbd-fuse-20.3.0-5184.ga1ac97f8.el10.x 4.3 MB/s | 87 kB 00:00 2026-02-19T21:01:14.335 INFO:teuthology.orchestra.run.trial175.stdout:(31/175): rbd-nbd-20.3.0-5184.ga1ac97f8.el10.x8 7.1 MB/s | 179 kB 00:00 2026-02-19T21:01:14.358 INFO:teuthology.orchestra.run.trial175.stdout:(32/175): ceph-grafana-dashboards-20.3.0-5184.g 2.5 MB/s | 57 kB 00:00 2026-02-19T21:01:14.383 INFO:teuthology.orchestra.run.trial175.stdout:(33/175): ceph-mgr-cephadm-20.3.0-5184.ga1ac97f 7.1 MB/s | 184 kB 00:00 2026-02-19T21:01:14.409 INFO:teuthology.orchestra.run.trial105.stdout:(8/175): ceph-mon-20.3.0-5184.ga1ac97f8.el10.x8 2.5 MB/s | 6.0 MB 00:02 2026-02-19T21:01:14.578 INFO:teuthology.orchestra.run.trial175.stdout:(34/175): rbd-mirror-20.3.0-5184.ga1ac97f8.el10 10 MB/s | 2.9 MB 00:00 2026-02-19T21:01:14.999 INFO:teuthology.orchestra.run.trial090.stdout:Transaction test succeeded. 2026-02-19T21:01:14.999 INFO:teuthology.orchestra.run.trial090.stdout:Running transaction 2026-02-19T21:01:15.203 INFO:teuthology.orchestra.run.trial175.stdout:(35/175): ceph-mgr-dashboard-20.3.0-5184.ga1ac9 18 MB/s | 15 MB 00:00 2026-02-19T21:01:15.230 INFO:teuthology.orchestra.run.trial175.stdout:(36/175): ceph-mgr-k8sevents-20.3.0-5184.ga1ac9 865 kB/s | 22 kB 00:00 2026-02-19T21:01:15.258 INFO:teuthology.orchestra.run.trial175.stdout:(37/175): ceph-mgr-modules-core-20.3.0-5184.ga1 10 MB/s | 297 kB 00:00 2026-02-19T21:01:15.283 INFO:teuthology.orchestra.run.trial175.stdout:(38/175): ceph-mgr-rook-20.3.0-5184.ga1ac97f8.e 2.0 MB/s | 50 kB 00:00 2026-02-19T21:01:15.307 INFO:teuthology.orchestra.run.trial175.stdout:(39/175): ceph-prometheus-alerts-20.3.0-5184.ga 738 kB/s | 17 kB 00:00 2026-02-19T21:01:15.323 INFO:teuthology.orchestra.run.trial175.stdout:(40/175): ceph-mgr-diskprediction-local-20.3.0- 9.9 MB/s | 7.4 MB 00:00 2026-02-19T21:01:15.334 INFO:teuthology.orchestra.run.trial175.stdout:(41/175): ceph-volume-20.3.0-5184.ga1ac97f8.el1 14 MB/s | 374 kB 00:00 2026-02-19T21:01:15.357 INFO:teuthology.orchestra.run.trial175.stdout:(42/175): cephfs-top-20.3.0-5184.ga1ac97f8.el10 775 kB/s | 18 kB 00:00 2026-02-19T21:01:15.413 INFO:teuthology.orchestra.run.trial175.stdout:(43/175): automake-1.16.5-20.el10.noarch.rpm 13 MB/s | 704 kB 00:00 2026-02-19T21:01:15.438 INFO:teuthology.orchestra.run.trial175.stdout:(44/175): cephadm-20.3.0-5184.ga1ac97f8.el10.no 12 MB/s | 1.3 MB 00:00 2026-02-19T21:01:15.440 INFO:teuthology.orchestra.run.trial175.stdout:(45/175): bison-3.8.2-9.el10.x86_64.rpm 35 MB/s | 1.0 MB 00:00 2026-02-19T21:01:15.457 INFO:teuthology.orchestra.run.trial175.stdout:(46/175): cmake-filesystem-3.30.5-3.el10_0.x86_ 915 kB/s | 15 kB 00:00 2026-02-19T21:01:15.460 INFO:teuthology.orchestra.run.trial175.stdout:(47/175): boost-program-options-1.83.0-5.el10.x 4.9 MB/s | 109 kB 00:00 2026-02-19T21:01:15.473 INFO:teuthology.orchestra.run.trial175.stdout:(48/175): elfutils-libelf-devel-0.193-1.el10.ro 3.0 MB/s | 48 kB 00:00 2026-02-19T21:01:15.480 INFO:teuthology.orchestra.run.trial175.stdout:(49/175): flex-2.6.4-19.el10.x86_64.rpm 15 MB/s | 300 kB 00:00 2026-02-19T21:01:15.487 INFO:teuthology.orchestra.run.trial175.stdout:(50/175): flexiblas-3.4.2-3.el10.x86_64.rpm 1.8 MB/s | 25 kB 00:00 2026-02-19T21:01:15.500 INFO:teuthology.orchestra.run.trial175.stdout:(51/175): flexiblas-openblas-openmp-3.4.2-3.el1 1.3 MB/s | 17 kB 00:00 2026-02-19T21:01:15.515 INFO:teuthology.orchestra.run.trial175.stdout:(52/175): ledmon-libs-1.1.0-2.el10.x86_64.rpm 2.7 MB/s | 42 kB 00:00 2026-02-19T21:01:15.529 INFO:teuthology.orchestra.run.trial175.stdout:(53/175): libaio-devel-0.3.111-22.el10.x86_64.r 758 kB/s | 10 kB 00:00 2026-02-19T21:01:15.547 INFO:teuthology.orchestra.run.trial175.stdout:(54/175): libnbd-1.22.2-3.el10_1.x86_64.rpm 9.7 MB/s | 175 kB 00:00 2026-02-19T21:01:15.563 INFO:teuthology.orchestra.run.trial175.stdout:(55/175): librabbitmq-0.14.0-3.el10.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2026-02-19T21:01:15.589 INFO:teuthology.orchestra.run.trial175.stdout:(56/175): librdkafka-2.1.1-7.el10.x86_64.rpm 27 MB/s | 725 kB 00:00 2026-02-19T21:01:15.608 INFO:teuthology.orchestra.run.trial175.stdout:(57/175): libstoragemgmt-1.10.1-4.el10.x86_64.r 13 MB/s | 251 kB 00:00 2026-02-19T21:01:15.628 INFO:teuthology.orchestra.run.trial175.stdout:(58/175): libtool-2.4.7-13.el10.x86_64.rpm 29 MB/s | 601 kB 00:00 2026-02-19T21:01:15.641 INFO:teuthology.orchestra.run.trial175.stdout:(59/175): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 2.6 MB/s | 36 kB 00:00 2026-02-19T21:01:15.659 INFO:teuthology.orchestra.run.trial175.stdout:(60/175): libuuid-devel-2.40.2-15.el10_1.x86_64 2.1 MB/s | 37 kB 00:00 2026-02-19T21:01:15.683 INFO:teuthology.orchestra.run.trial175.stdout:(61/175): libxslt-1.1.39-8.el10_0.x86_64.rpm 7.7 MB/s | 189 kB 00:00 2026-02-19T21:01:15.698 INFO:teuthology.orchestra.run.trial175.stdout:(62/175): libzstd-devel-1.5.5-9.el10.x86_64.rpm 3.4 MB/s | 51 kB 00:00 2026-02-19T21:01:15.720 INFO:teuthology.orchestra.run.trial175.stdout:(63/175): lua-5.4.6-7.el10.x86_64.rpm 8.7 MB/s | 190 kB 00:00 2026-02-19T21:01:15.734 INFO:teuthology.orchestra.run.trial175.stdout:(64/175): openblas-0.3.29-2.el10.x86_64.rpm 3.0 MB/s | 43 kB 00:00 2026-02-19T21:01:15.822 INFO:teuthology.orchestra.run.trial175.stdout:(65/175): flexiblas-netlib-3.4.2-3.el10.x86_64. 9.4 MB/s | 3.2 MB 00:00 2026-02-19T21:01:15.828 INFO:teuthology.orchestra.run.trial175.stdout:(66/175): openblas-openmp-0.3.29-2.el10.x86_64. 56 MB/s | 5.3 MB 00:00 2026-02-19T21:01:15.843 INFO:teuthology.orchestra.run.trial175.stdout:(67/175): perl-Thread-Queue-3.14-511.el10.noarc 1.4 MB/s | 21 kB 00:00 2026-02-19T21:01:15.858 INFO:teuthology.orchestra.run.trial175.stdout:(68/175): perl-threads-2.40-511.el10.x86_64.rpm 3.9 MB/s | 58 kB 00:00 2026-02-19T21:01:15.874 INFO:teuthology.orchestra.run.trial175.stdout:(69/175): openssl-devel-3.5.1-7.el10_1.x86_64.r 59 MB/s | 3.0 MB 00:00 2026-02-19T21:01:15.875 INFO:teuthology.orchestra.run.trial175.stdout:(70/175): perl-threads-shared-1.69-511.el10.x86 2.6 MB/s | 45 kB 00:00 2026-02-19T21:01:15.892 INFO:teuthology.orchestra.run.trial105.stdout:(9/175): ceph-osd-classic-20.3.0-5184.ga1ac97f8 4.7 MB/s | 17 MB 00:03 2026-02-19T21:01:15.910 INFO:teuthology.orchestra.run.trial175.stdout:(71/175): postgresql-contrib-16.11-1.el10_1.x86 29 MB/s | 1.0 MB 00:00 2026-02-19T21:01:15.919 INFO:teuthology.orchestra.run.trial175.stdout:(72/175): postgresql-16.11-1.el10_1.x86_64.rpm 44 MB/s | 2.0 MB 00:00 2026-02-19T21:01:15.927 INFO:teuthology.orchestra.run.trial175.stdout:(73/175): postgresql-private-libs-16.11-1.el10_ 8.1 MB/s | 143 kB 00:00 2026-02-19T21:01:15.965 INFO:teuthology.orchestra.run.trial175.stdout:(74/175): protobuf-3.19.6-11.el10.x86_64.rpm 27 MB/s | 1.0 MB 00:00 2026-02-19T21:01:15.983 INFO:teuthology.orchestra.run.trial175.stdout:(75/175): python3-colorama-0.4.6-13.el10.noarch 3.9 MB/s | 74 kB 00:00 2026-02-19T21:01:16.003 INFO:teuthology.orchestra.run.trial175.stdout:(76/175): python3-devel-3.12.12-3.el10_1.x86_64 17 MB/s | 329 kB 00:00 2026-02-19T21:01:16.029 INFO:teuthology.orchestra.run.trial175.stdout:(77/175): postgresql-server-16.11-1.el10_1.x86_ 64 MB/s | 7.0 MB 00:00 2026-02-19T21:01:16.030 INFO:teuthology.orchestra.run.trial175.stdout:(78/175): python3-jinja2-3.1.6-1.el10_0.noarch. 12 MB/s | 330 kB 00:00 2026-02-19T21:01:16.043 INFO:teuthology.orchestra.run.trial175.stdout:(79/175): python3-jmespath-1.0.1-8.el10.noarch. 4.2 MB/s | 60 kB 00:00 2026-02-19T21:01:16.048 INFO:teuthology.orchestra.run.trial175.stdout:(80/175): python3-libstoragemgmt-1.10.1-4.el10. 12 MB/s | 219 kB 00:00 2026-02-19T21:01:16.064 INFO:teuthology.orchestra.run.trial175.stdout:(81/175): python3-markupsafe-2.1.3-6.el10.x86_6 2.1 MB/s | 34 kB 00:00 2026-02-19T21:01:16.075 INFO:teuthology.orchestra.run.trial175.stdout:(82/175): python3-lxml-5.2.1-4.el10.x86_64.rpm 44 MB/s | 1.4 MB 00:00 2026-02-19T21:01:16.096 INFO:teuthology.orchestra.run.trial175.stdout:(83/175): python3-numpy-f2py-1.26.4-5.el10.x86_ 23 MB/s | 490 kB 00:00 2026-02-19T21:01:16.120 INFO:teuthology.orchestra.run.trial175.stdout:(84/175): python3-prettytable-3.6.0-10.el10.noa 2.9 MB/s | 70 kB 00:00 2026-02-19T21:01:16.120 INFO:teuthology.orchestra.run.trial090.stdout: Preparing : 1/1 2026-02-19T21:01:16.124 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 1/177 2026-02-19T21:01:16.127 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 2/177 2026-02-19T21:01:16.134 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 3/177 2026-02-19T21:01:16.141 INFO:teuthology.orchestra.run.trial175.stdout:(85/175): python3-protobuf-3.19.6-11.el10.x86_6 19 MB/s | 419 kB 00:00 2026-02-19T21:01:16.159 INFO:teuthology.orchestra.run.trial175.stdout:(86/175): python3-pyasn1-0.6.1-1.el10.noarch.rp 11 MB/s | 198 kB 00:00 2026-02-19T21:01:16.178 INFO:teuthology.orchestra.run.trial175.stdout:(87/175): python3-pyasn1-modules-0.6.1-1.el10.n 21 MB/s | 402 kB 00:00 2026-02-19T21:01:16.188 INFO:teuthology.orchestra.run.trial175.stdout:(88/175): python3-numpy-1.26.4-5.el10.x86_64.rp 54 MB/s | 6.7 MB 00:00 2026-02-19T21:01:16.194 INFO:teuthology.orchestra.run.trial175.stdout:(89/175): python3-requests-oauthlib-1.3.1-11.el 3.6 MB/s | 60 kB 00:00 2026-02-19T21:01:16.213 INFO:teuthology.orchestra.run.trial175.stdout:(90/175): qatlib-24.09.0-2.el10.x86_64.rpm 12 MB/s | 229 kB 00:00 2026-02-19T21:01:16.229 INFO:teuthology.orchestra.run.trial175.stdout:(91/175): qatlib-service-24.09.0-2.el10.x86_64. 2.3 MB/s | 37 kB 00:00 2026-02-19T21:01:16.245 INFO:teuthology.orchestra.run.trial175.stdout:(92/175): qatzip-libs-1.3.1-1.el10.x86_64.rpm 3.9 MB/s | 66 kB 00:00 2026-02-19T21:01:16.249 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 4/177 2026-02-19T21:01:16.253 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 5/177 2026-02-19T21:01:16.265 INFO:teuthology.orchestra.run.trial175.stdout:(93/175): socat-1.7.4.4-8.el10.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-19T21:01:16.285 INFO:teuthology.orchestra.run.trial175.stdout:(94/175): utf8proc-2.7.0-9.el10.x86_64.rpm 3.9 MB/s | 80 kB 00:00 2026-02-19T21:01:16.293 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 5/177 2026-02-19T21:01:16.294 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 6/177 2026-02-19T21:01:16.300 INFO:teuthology.orchestra.run.trial175.stdout:(95/175): uuid-1.6.2-65.el10.x86_64.rpm 3.9 MB/s | 59 kB 00:00 2026-02-19T21:01:16.306 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 6/177 2026-02-19T21:01:16.309 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-daemon-2:20.3.0-5184.ga1ac97f8.el10.x8 7/177 2026-02-19T21:01:16.309 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x8 8/177 2026-02-19T21:01:16.318 INFO:teuthology.orchestra.run.trial175.stdout:(96/175): xfsprogs-devel-6.11.0-2.el10.x86_64.r 5.6 MB/s | 105 kB 00:00 2026-02-19T21:01:16.333 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x8 8/177 2026-02-19T21:01:16.337 INFO:teuthology.orchestra.run.trial175.stdout:(97/175): xmlsec1-1.2.39-3.el10.x86_64.rpm 10 MB/s | 193 kB 00:00 2026-02-19T21:01:16.339 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rados-2:20.3.0-5184.ga1ac97f8.el10.x86_6 9/177 2026-02-19T21:01:16.341 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 10/177 2026-02-19T21:01:16.343 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 11/177 2026-02-19T21:01:16.349 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 12/177 2026-02-19T21:01:16.351 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 13/177 2026-02-19T21:01:16.354 INFO:teuthology.orchestra.run.trial090.stdout: Installing : daxctl-libs-80-4.el10.x86_64 14/177 2026-02-19T21:01:16.356 INFO:teuthology.orchestra.run.trial175.stdout:(98/175): xmlsec1-openssl-1.2.39-3.el10.x86_64. 5.2 MB/s | 96 kB 00:00 2026-02-19T21:01:16.357 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-private-libs-16.11-1.el10_1.x86_64 15/177 2026-02-19T21:01:16.371 INFO:teuthology.orchestra.run.trial175.stdout:(99/175): xmlstarlet-1.6.1-27.el10.x86_64.rpm 4.0 MB/s | 63 kB 00:00 2026-02-19T21:01:16.385 INFO:teuthology.orchestra.run.trial175.stdout:(100/175): zlib-ng-compat-devel-2.2.3-3.el10_1. 2.5 MB/s | 36 kB 00:00 2026-02-19T21:01:16.388 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 16/177 2026-02-19T21:01:16.392 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-16.11-1.el10_1.x86_64 17/177 2026-02-19T21:01:16.398 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ndctl-libs-80-4.el10.x86_64 18/177 2026-02-19T21:01:16.399 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_6 19/177 2026-02-19T21:01:16.418 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_6 19/177 2026-02-19T21:01:16.419 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x8 20/177 2026-02-19T21:01:16.423 INFO:teuthology.orchestra.run.trial175.stdout:(101/175): python3-scipy-1.11.3-17.el10.x86_64. 69 MB/s | 16 MB 00:00 2026-02-19T21:01:16.424 INFO:teuthology.orchestra.run.trial175.stdout:(102/175): cryptsetup-2.7.5-2.el10.x86_64.rpm 8.5 MB/s | 335 kB 00:00 2026-02-19T21:01:16.438 INFO:teuthology.orchestra.run.trial175.stdout:(103/175): daxctl-libs-80-4.el10.x86_64.rpm 2.8 MB/s | 42 kB 00:00 2026-02-19T21:01:16.439 INFO:teuthology.orchestra.run.trial175.stdout:(104/175): fuse3-3.16.2-5.el10.x86_64.rpm 3.8 MB/s | 58 kB 00:00 2026-02-19T21:01:16.452 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x8 20/177 2026-02-19T21:01:16.456 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 21/177 2026-02-19T21:01:16.457 INFO:teuthology.orchestra.run.trial175.stdout:(105/175): libconfig-1.7.3-10.el10.x86_64.rpm 4.1 MB/s | 72 kB 00:00 2026-02-19T21:01:16.458 INFO:teuthology.orchestra.run.trial090.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 22/177 2026-02-19T21:01:16.460 INFO:teuthology.orchestra.run.trial090.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 23/177 2026-02-19T21:01:16.481 INFO:teuthology.orchestra.run.trial175.stdout:(106/175): hwloc-libs-2.11.1-3.el10.x86_64.rpm 49 MB/s | 2.1 MB 00:00 2026-02-19T21:01:16.482 INFO:teuthology.orchestra.run.trial175.stdout:(107/175): libgfortran-14.3.1-2.1.el10.x86_64.r 32 MB/s | 827 kB 00:00 2026-02-19T21:01:16.484 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 24/177 2026-02-19T21:01:16.489 INFO:teuthology.orchestra.run.trial090.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 25/177 2026-02-19T21:01:16.492 INFO:teuthology.orchestra.run.trial090.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 26/177 2026-02-19T21:01:16.497 INFO:teuthology.orchestra.run.trial175.stdout:(108/175): libpciaccess-0.16-16.el10.x86_64.rpm 1.7 MB/s | 27 kB 00:00 2026-02-19T21:01:16.500 INFO:teuthology.orchestra.run.trial175.stdout:(109/175): libquadmath-14.3.1-2.1.el10.x86_64.r 12 MB/s | 215 kB 00:00 2026-02-19T21:01:16.502 INFO:teuthology.orchestra.run.trial090.stdout: Installing : unzip-6.0-69.el10.x86_64 27/177 2026-02-19T21:01:16.507 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 28/177 2026-02-19T21:01:16.512 INFO:teuthology.orchestra.run.trial175.stdout:(110/175): mailcap-2.1.54-8.el10.noarch.rpm 2.1 MB/s | 34 kB 00:00 2026-02-19T21:01:16.513 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 29/177 2026-02-19T21:01:16.517 INFO:teuthology.orchestra.run.trial175.stdout:(111/175): ndctl-libs-80-4.el10.x86_64.rpm 5.1 MB/s | 89 kB 00:00 2026-02-19T21:01:16.521 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-packaging-24.2-2.el10.noarch 30/177 2026-02-19T21:01:16.524 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 31/177 2026-02-19T21:01:16.527 INFO:teuthology.orchestra.run.trial090.stdout: Installing : perl-threads-1:2.40-511.el10.x86_64 32/177 2026-02-19T21:01:16.529 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-5.4.6-7.el10.x86_64 33/177 2026-02-19T21:01:16.530 INFO:teuthology.orchestra.run.trial175.stdout:(112/175): ocl-icd-2.3.2-8.el10.x86_64.rpm 3.7 MB/s | 66 kB 00:00 2026-02-19T21:01:16.532 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 34/177 2026-02-19T21:01:16.533 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 35/177 2026-02-19T21:01:16.535 INFO:teuthology.orchestra.run.trial175.stdout:(113/175): pciutils-3.13.0-6.el10.x86_64.rpm 6.8 MB/s | 122 kB 00:00 2026-02-19T21:01:16.547 INFO:teuthology.orchestra.run.trial175.stdout:(114/175): python3-cffi-1.16.0-7.el10.x86_64.rp 18 MB/s | 310 kB 00:00 2026-02-19T21:01:16.550 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 36/177 2026-02-19T21:01:16.554 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-common-2:20.3.0-5184.ga1ac97f8.el10 37/177 2026-02-19T21:01:16.563 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ceph-argparse-2:20.3.0-5184.ga1ac97f8.el 38/177 2026-02-19T21:01:16.565 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cephfs-2:20.3.0-5184.ga1ac97f8.el10.x86_ 39/177 2026-02-19T21:01:16.567 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 40/177 2026-02-19T21:01:16.569 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 41/177 2026-02-19T21:01:16.571 INFO:teuthology.orchestra.run.trial090.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 42/177 2026-02-19T21:01:16.572 INFO:teuthology.orchestra.run.trial090.stdout: Installing : perl-threads-shared-1.69-511.el10.x86_64 43/177 2026-02-19T21:01:16.583 INFO:teuthology.orchestra.run.trial090.stdout: Installing : perl-Thread-Queue-3.14-511.el10.noarch 44/177 2026-02-19T21:01:16.583 INFO:teuthology.orchestra.run.trial105.stdout:(10/175): ceph-common-20.3.0-5184.ga1ac97f8.el1 3.0 MB/s | 25 MB 00:08 2026-02-19T21:01:16.595 INFO:teuthology.orchestra.run.trial105.stdout:(11/175): ceph-selinux-20.3.0-5184.ga1ac97f8.el 2.1 MB/s | 25 kB 00:00 2026-02-19T21:01:16.606 INFO:teuthology.orchestra.run.trial090.stdout: Installing : automake-1.16.5-20.el10.noarch 45/177 2026-02-19T21:01:16.611 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 46/177 2026-02-19T21:01:16.616 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 47/177 2026-02-19T21:01:16.620 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 48/177 2026-02-19T21:01:16.629 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zip-3.0-45.el10.x86_64 49/177 2026-02-19T21:01:16.632 INFO:teuthology.orchestra.run.trial090.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 50/177 2026-02-19T21:01:16.634 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 51/177 2026-02-19T21:01:16.669 INFO:teuthology.orchestra.run.trial175.stdout:(115/175): ceph-test-20.3.0-5184.ga1ac97f8.el10 20 MB/s | 81 MB 00:04 2026-02-19T21:01:16.673 INFO:teuthology.orchestra.run.trial175.stdout:(116/175): python3-packaging-24.2-2.el10.noarch 1.2 MB/s | 155 kB 00:00 2026-02-19T21:01:16.689 INFO:teuthology.orchestra.run.trial175.stdout:(117/175): python3-ply-3.11-25.el10.noarch.rpm 6.9 MB/s | 137 kB 00:00 2026-02-19T21:01:16.691 INFO:teuthology.orchestra.run.trial175.stdout:(118/175): python3-cryptography-43.0.0-4.el10.x 8.7 MB/s | 1.3 MB 00:00 2026-02-19T21:01:16.692 INFO:teuthology.orchestra.run.trial175.stdout:(119/175): python3-pycparser-2.20-16.el10.noarc 8.4 MB/s | 160 kB 00:00 2026-02-19T21:01:16.706 INFO:teuthology.orchestra.run.trial175.stdout:(120/175): python3-requests-2.32.4-1.el10_0.noa 8.9 MB/s | 160 kB 00:00 2026-02-19T21:01:16.709 INFO:teuthology.orchestra.run.trial175.stdout:(121/175): python3-urllib3-1.26.19-2.el10_1.1.n 16 MB/s | 285 kB 00:00 2026-02-19T21:01:16.711 INFO:teuthology.orchestra.run.trial175.stdout:(122/175): unzip-6.0-69.el10.x86_64.rpm 9.4 MB/s | 188 kB 00:00 2026-02-19T21:01:16.723 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 52/177 2026-02-19T21:01:16.724 INFO:teuthology.orchestra.run.trial175.stdout:(123/175): zip-3.0-45.el10.x86_64.rpm 15 MB/s | 271 kB 00:00 2026-02-19T21:01:16.724 INFO:teuthology.orchestra.run.trial090.stdout: Upgrading : librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 53/177 2026-02-19T21:01:16.726 INFO:teuthology.orchestra.run.trial175.stdout:(124/175): lua-devel-5.4.6-7.el10.x86_64.rpm 1.5 MB/s | 22 kB 00:00 2026-02-19T21:01:16.727 INFO:teuthology.orchestra.run.trial175.stdout:(125/175): lttng-ust-2.13.7-5.el10.x86_64.rpm 18 MB/s | 334 kB 00:00 2026-02-19T21:01:16.744 INFO:teuthology.orchestra.run.trial175.stdout:(126/175): protobuf-compiler-3.19.6-11.el10.x86 39 MB/s | 787 kB 00:00 2026-02-19T21:01:16.753 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 53/177 2026-02-19T21:01:16.756 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 54/177 2026-02-19T21:01:16.758 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 55/177 2026-02-19T21:01:16.764 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 56/177 2026-02-19T21:01:16.766 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librados-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_ 57/177 2026-02-19T21:01:16.780 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 58/177 2026-02-19T21:01:16.787 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 59/177 2026-02-19T21:01:16.789 INFO:teuthology.orchestra.run.trial175.stdout:(127/175): grpc-data-1.48.4-44.el10_0.noarch.rp 457 kB/s | 21 kB 00:00 2026-02-19T21:01:16.792 INFO:teuthology.orchestra.run.trial090.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 60/177 2026-02-19T21:01:16.802 INFO:teuthology.orchestra.run.trial090.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 61/177 2026-02-19T21:01:16.805 INFO:teuthology.orchestra.run.trial090.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 62/177 2026-02-19T21:01:16.807 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 63/177 2026-02-19T21:01:16.809 INFO:teuthology.orchestra.run.trial175.stdout:(128/175): abseil-cpp-20240722.1-1.el10_0.x86_6 7.0 MB/s | 590 kB 00:00 2026-02-19T21:01:16.812 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 64/177 2026-02-19T21:01:16.814 INFO:teuthology.orchestra.run.trial175.stdout:(129/175): gperftools-libs-2.15-4.el10_0.x86_64 3.4 MB/s | 303 kB 00:00 2026-02-19T21:01:16.815 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 65/177 2026-02-19T21:01:16.820 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 66/177 2026-02-19T21:01:16.822 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 67/177 2026-02-19T21:01:16.824 INFO:teuthology.orchestra.run.trial175.stdout:(130/175): libarrow-doc-17.0.0-9.el10_2.noarch. 1.7 MB/s | 27 kB 00:00 2026-02-19T21:01:16.830 INFO:teuthology.orchestra.run.trial175.stdout:(131/175): liboath-2.6.12-1.el10_0.x86_64.rpm 2.9 MB/s | 48 kB 00:00 2026-02-19T21:01:16.832 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyperclip-1.8.2-1.el10_0.noarch 68/177 2026-02-19T21:01:16.837 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cmd2-2.5.8-1.el10_2.noarch 69/177 2026-02-19T21:01:16.840 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 70/177 2026-02-19T21:01:16.842 INFO:teuthology.orchestra.run.trial175.stdout:(132/175): liborc2-2.0.7-1.el10_2.x86_64.rpm 29 MB/s | 515 kB 00:00 2026-02-19T21:01:16.844 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 71/177 2026-02-19T21:01:16.847 INFO:teuthology.orchestra.run.trial175.stdout:(133/175): libpmem-2.1.0-2.el10_0.x86_64.rpm 6.6 MB/s | 112 kB 00:00 2026-02-19T21:01:16.850 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 72/177 2026-02-19T21:01:16.853 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 73/177 2026-02-19T21:01:16.855 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 74/177 2026-02-19T21:01:16.857 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 75/177 2026-02-19T21:01:16.857 INFO:teuthology.orchestra.run.trial175.stdout:(134/175): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 10 MB/s | 161 kB 00:00 2026-02-19T21:01:16.863 INFO:teuthology.orchestra.run.trial175.stdout:(135/175): libunwind-1.8.0-4.el10_0.x86_64.rpm 4.4 MB/s | 73 kB 00:00 2026-02-19T21:01:16.871 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 76/177 2026-02-19T21:01:16.875 INFO:teuthology.orchestra.run.trial175.stdout:(136/175): libarrow-17.0.0-9.el10_2.x86_64.rpm 66 MB/s | 5.7 MB 00:00 2026-02-19T21:01:16.876 INFO:teuthology.orchestra.run.trial175.stdout:(137/175): luarocks-3.9.2-6.el10_0.noarch.rpm 8.1 MB/s | 152 kB 00:00 2026-02-19T21:01:16.888 INFO:teuthology.orchestra.run.trial175.stdout:(138/175): parquet-libs-17.0.0-9.el10_2.x86_64. 40 MB/s | 1.0 MB 00:00 2026-02-19T21:01:16.896 INFO:teuthology.orchestra.run.trial175.stdout:(139/175): python3-autocommand-2.2.2-9.el10_0.n 1.6 MB/s | 32 kB 00:00 2026-02-19T21:01:16.898 INFO:teuthology.orchestra.run.trial175.stdout:(140/175): python3-asyncssh-2.17.0-1.el10_0.noa 34 MB/s | 756 kB 00:00 2026-02-19T21:01:16.907 INFO:teuthology.orchestra.run.trial175.stdout:(141/175): python3-bcrypt-4.3.0-3.el10_1.x86_64 12 MB/s | 238 kB 00:00 2026-02-19T21:01:16.914 INFO:teuthology.orchestra.run.trial175.stdout:(142/175): python3-cachetools-5.4.0-6.el10_0.no 2.0 MB/s | 37 kB 00:00 2026-02-19T21:01:16.916 INFO:teuthology.orchestra.run.trial175.stdout:(143/175): python3-certifi-2023.05.07-6.el10_0. 782 kB/s | 14 kB 00:00 2026-02-19T21:01:16.926 INFO:teuthology.orchestra.run.trial175.stdout:(144/175): python3-cheroot-10.0.1-4.el10_0.noar 11 MB/s | 215 kB 00:00 2026-02-19T21:01:16.934 INFO:teuthology.orchestra.run.trial175.stdout:(145/175): python3-cherrypy-18.10.0-4.el10_0.no 18 MB/s | 359 kB 00:00 2026-02-19T21:01:16.936 INFO:teuthology.orchestra.run.trial175.stdout:(146/175): python3-cmd2-2.5.8-1.el10_2.noarch.r 18 MB/s | 375 kB 00:00 2026-02-19T21:01:16.944 INFO:teuthology.orchestra.run.trial105.stdout:(12/175): ceph-osd-crimson-20.3.0-5184.ga1ac97f 7.8 MB/s | 20 MB 00:02 2026-02-19T21:01:16.944 INFO:teuthology.orchestra.run.trial175.stdout:(147/175): python3-durationpy-0.9-2.el10_0.noar 831 kB/s | 15 kB 00:00 2026-02-19T21:01:16.953 INFO:teuthology.orchestra.run.trial175.stdout:(148/175): python3-google-auth-2.40.3-1.el10_1. 15 MB/s | 286 kB 00:00 2026-02-19T21:01:16.962 INFO:teuthology.orchestra.run.trial105.stdout:(13/175): ceph-radosgw-20.3.0-5184.ga1ac97f8.el 13 MB/s | 14 MB 00:01 2026-02-19T21:01:16.963 INFO:teuthology.orchestra.run.trial175.stdout:(149/175): python3-grpcio-tools-1.48.4-44.el10_ 8.3 MB/s | 157 kB 00:00 2026-02-19T21:01:16.972 INFO:teuthology.orchestra.run.trial175.stdout:(150/175): python3-grpcio-1.48.4-44.el10_0.x86_ 66 MB/s | 2.3 MB 00:00 2026-02-19T21:01:16.972 INFO:teuthology.orchestra.run.trial175.stdout:(151/175): python3-isodate-0.6.1-14.el10_0.noar 3.5 MB/s | 66 kB 00:00 2026-02-19T21:01:16.974 INFO:teuthology.orchestra.run.trial105.stdout:(14/175): cephfs-mirror-20.3.0-5184.ga1ac97f8.e 8.3 MB/s | 252 kB 00:00 2026-02-19T21:01:16.974 INFO:teuthology.orchestra.run.trial105.stdout:(15/175): cephfs-shell-20.3.0-5184.ga1ac97f8.el 2.2 MB/s | 27 kB 00:00 2026-02-19T21:01:16.981 INFO:teuthology.orchestra.run.trial175.stdout:(152/175): python3-jaraco-collections-5.1.0-1.e 1.6 MB/s | 29 kB 00:00 2026-02-19T21:01:16.986 INFO:teuthology.orchestra.run.trial105.stdout:(16/175): libcephfs-daemon-20.3.0-5184.ga1ac97f 2.9 MB/s | 36 kB 00:00 2026-02-19T21:01:16.986 INFO:teuthology.orchestra.run.trial105.stdout:(17/175): libcephfs-devel-20.3.0-5184.ga1ac97f8 3.0 MB/s | 37 kB 00:00 2026-02-19T21:01:16.990 INFO:teuthology.orchestra.run.trial175.stdout:(153/175): python3-jaraco-context-6.0.1-4.el10_ 1.2 MB/s | 21 kB 00:00 2026-02-19T21:01:16.991 INFO:teuthology.orchestra.run.trial175.stdout:(154/175): python3-jaraco-functools-4.0.2-4.el1 1.2 MB/s | 23 kB 00:00 2026-02-19T21:01:16.998 INFO:teuthology.orchestra.run.trial105.stdout:(18/175): libcephfs-proxy2-20.3.0-5184.ga1ac97f 2.1 MB/s | 25 kB 00:00 2026-02-19T21:01:16.999 INFO:teuthology.orchestra.run.trial175.stdout:(155/175): python3-jaraco-text-4.0.0-3.el10_0.n 1.6 MB/s | 29 kB 00:00 2026-02-19T21:01:17.009 INFO:teuthology.orchestra.run.trial175.stdout:(156/175): python3-more-itertools-10.1.0-8.el10 5.4 MB/s | 100 kB 00:00 2026-02-19T21:01:17.010 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 77/177 2026-02-19T21:01:17.011 INFO:teuthology.orchestra.run.trial105.stdout:(19/175): libcephsqlite-20.3.0-5184.ga1ac97f8.e 13 MB/s | 168 kB 00:00 2026-02-19T21:01:17.015 INFO:teuthology.orchestra.run.trial175.stdout:(157/175): python3-kubernetes-32.0.1-1.el10_1.n 52 MB/s | 1.3 MB 00:00 2026-02-19T21:01:17.017 INFO:teuthology.orchestra.run.trial175.stdout:(158/175): python3-natsort-8.4.0-2.el10_0.noarc 3.9 MB/s | 72 kB 00:00 2026-02-19T21:01:17.018 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 78/177 2026-02-19T21:01:17.021 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 79/177 2026-02-19T21:01:17.022 INFO:teuthology.orchestra.run.trial105.stdout:(20/175): librados-devel-20.3.0-5184.ga1ac97f8. 11 MB/s | 128 kB 00:00 2026-02-19T21:01:17.024 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 80/177 2026-02-19T21:01:17.026 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 81/177 2026-02-19T21:01:17.027 INFO:teuthology.orchestra.run.trial175.stdout:(159/175): python3-portend-3.2.0-6.el10_0.noarc 1.0 MB/s | 18 kB 00:00 2026-02-19T21:01:17.029 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 82/177 2026-02-19T21:01:17.033 INFO:teuthology.orchestra.run.trial105.stdout:(21/175): libcephfs2-20.3.0-5184.ga1ac97f8.el10 20 MB/s | 937 kB 00:00 2026-02-19T21:01:17.033 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 83/177 2026-02-19T21:01:17.034 INFO:teuthology.orchestra.run.trial175.stdout:(160/175): python3-pyOpenSSL-25.0.0-1.el10_1.no 6.1 MB/s | 113 kB 00:00 2026-02-19T21:01:17.035 INFO:teuthology.orchestra.run.trial090.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 84/177 2026-02-19T21:01:17.036 INFO:teuthology.orchestra.run.trial175.stdout:(161/175): python3-pyperclip-1.8.2-1.el10_0.noa 1.5 MB/s | 28 kB 00:00 2026-02-19T21:01:17.045 INFO:teuthology.orchestra.run.trial175.stdout:(162/175): python3-repoze-lru-0.7-23.el10_0.noa 1.9 MB/s | 36 kB 00:00 2026-02-19T21:01:17.045 INFO:teuthology.orchestra.run.trial105.stdout:(22/175): libradosstriper1-20.3.0-5184.ga1ac97f 11 MB/s | 251 kB 00:00 2026-02-19T21:01:17.052 INFO:teuthology.orchestra.run.trial175.stdout:(163/175): python3-routes-2.5.1-11.el10_0.noarc 11 MB/s | 201 kB 00:00 2026-02-19T21:01:17.054 INFO:teuthology.orchestra.run.trial175.stdout:(164/175): python3-rsa-4.9-7.el10_0.noarch.rpm 3.7 MB/s | 70 kB 00:00 2026-02-19T21:01:17.057 INFO:teuthology.orchestra.run.trial105.stdout:(23/175): python3-ceph-argparse-20.3.0-5184.ga1 4.8 MB/s | 57 kB 00:00 2026-02-19T21:01:17.058 INFO:teuthology.orchestra.run.trial090.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 85/177 2026-02-19T21:01:17.063 INFO:teuthology.orchestra.run.trial175.stdout:(165/175): python3-tempora-5.7.0-1.el10_0.noarc 2.0 MB/s | 37 kB 00:00 2026-02-19T21:01:17.063 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 86/177 2026-02-19T21:01:17.067 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 87/177 2026-02-19T21:01:17.071 INFO:teuthology.orchestra.run.trial175.stdout:(166/175): python3-websocket-client-1.8.0-2.el1 6.6 MB/s | 124 kB 00:00 2026-02-19T21:01:17.072 INFO:teuthology.orchestra.run.trial175.stdout:(167/175): python3-xmltodict-0.13.0-5.el10_0.no 1.4 MB/s | 26 kB 00:00 2026-02-19T21:01:17.073 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-ply-3.11-25.el10.noarch 88/177 2026-02-19T21:01:17.080 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 89/177 2026-02-19T21:01:17.080 INFO:teuthology.orchestra.run.trial105.stdout:(24/175): python3-ceph-common-20.3.0-5184.ga1ac 10 MB/s | 237 kB 00:00 2026-02-19T21:01:17.081 INFO:teuthology.orchestra.run.trial175.stdout:(168/175): python3-zc-lockfile-3.0.post1-11.el1 1.2 MB/s | 23 kB 00:00 2026-02-19T21:01:17.087 INFO:teuthology.orchestra.run.trial175.stdout:(169/175): re2-20251105-1.el10_2.x86_64.rpm 13 MB/s | 221 kB 00:00 2026-02-19T21:01:17.091 INFO:teuthology.orchestra.run.trial175.stdout:(170/175): python3-saml-1.16.0-11.el10.noarch.r 40 MB/s | 150 kB 00:00 2026-02-19T21:01:17.093 INFO:teuthology.orchestra.run.trial175.stdout:(171/175): python3-xmlsec-1.3.16-1.el10.x86_64. 24 MB/s | 49 kB 00:00 2026-02-19T21:01:17.098 INFO:teuthology.orchestra.run.trial175.stdout:(172/175): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rp 7.7 MB/s | 127 kB 00:00 2026-02-19T21:01:17.103 INFO:teuthology.orchestra.run.trial105.stdout:(25/175): python3-cephfs-20.3.0-5184.ga1ac97f8. 11 MB/s | 253 kB 00:00 2026-02-19T21:01:17.111 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 90/177 2026-02-19T21:01:17.117 INFO:teuthology.orchestra.run.trial175.stdout:(173/175): thrift-0.20.0-4.el10_1.x86_64.rpm 38 MB/s | 1.7 MB 00:00 2026-02-19T21:01:17.118 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 91/177 2026-02-19T21:01:17.126 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 92/177 2026-02-19T21:01:17.127 INFO:teuthology.orchestra.run.trial105.stdout:(26/175): python3-rados-20.3.0-5184.ga1ac97f8.e 15 MB/s | 353 kB 00:00 2026-02-19T21:01:17.137 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 93/177 2026-02-19T21:01:17.158 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 94/177 2026-02-19T21:01:17.163 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 95/177 2026-02-19T21:01:17.165 INFO:teuthology.orchestra.run.trial090.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 96/177 2026-02-19T21:01:17.165 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 97/177 2026-02-19T21:01:17.170 INFO:teuthology.orchestra.run.trial105.stdout:(27/175): python3-rbd-20.3.0-5184.ga1ac97f8.el1 8.3 MB/s | 371 kB 00:00 2026-02-19T21:01:17.183 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 97/177 2026-02-19T21:01:17.195 INFO:teuthology.orchestra.run.trial105.stdout:(28/175): python3-rgw-20.3.0-5184.ga1ac97f8.el1 5.2 MB/s | 130 kB 00:00 2026-02-19T21:01:17.201 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 98/177 2026-02-19T21:01:17.203 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 98/177 2026-02-19T21:01:17.205 INFO:teuthology.orchestra.run.trial090.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 99/177 2026-02-19T21:01:17.207 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 100/177 2026-02-19T21:01:17.209 INFO:teuthology.orchestra.run.trial090.stdout: Installing : mailcap-2.1.54-8.el10.noarch 101/177 2026-02-19T21:01:17.211 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 102/177 2026-02-19T21:01:17.218 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 103/177 2026-02-19T21:01:17.220 INFO:teuthology.orchestra.run.trial105.stdout:(29/175): rbd-fuse-20.3.0-5184.ga1ac97f8.el10.x 3.4 MB/s | 87 kB 00:00 2026-02-19T21:01:17.220 INFO:teuthology.orchestra.run.trial090.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 104/177 2026-02-19T21:01:17.221 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 105/177 2026-02-19T21:01:17.242 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:17.242 INFO:teuthology.orchestra.run.trial090.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-19T21:01:17.242 INFO:teuthology.orchestra.run.trial090.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-19T21:01:17.242 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:17.249 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:17.255 INFO:teuthology.orchestra.run.trial175.stdout:(174/175): librados2-20.3.0-5184.ga1ac97f8.el10 22 MB/s | 3.6 MB 00:00 2026-02-19T21:01:17.273 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:17.273 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-19T21:01:17.273 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:17.282 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 107/177 2026-02-19T21:01:17.291 INFO:teuthology.orchestra.run.trial090.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 108/177 2026-02-19T21:01:17.293 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 109/177 2026-02-19T21:01:17.296 INFO:teuthology.orchestra.run.trial090.stdout: Installing : uuid-1.6.2-65.el10.x86_64 110/177 2026-02-19T21:01:17.332 INFO:teuthology.orchestra.run.trial090.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 111/177 2026-02-19T21:01:17.337 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 112/177 2026-02-19T21:01:17.340 INFO:teuthology.orchestra.run.trial090.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 113/177 2026-02-19T21:01:17.343 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 114/177 2026-02-19T21:01:17.347 INFO:teuthology.orchestra.run.trial175.stdout:(175/175): librbd1-20.3.0-5184.ga1ac97f8.el10.x 11 MB/s | 2.8 MB 00:00 2026-02-19T21:01:17.348 INFO:teuthology.orchestra.run.trial175.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:01:17.348 INFO:teuthology.orchestra.run.trial175.stdout:Total 34 MB/s | 298 MB 00:08 2026-02-19T21:01:17.348 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction check 2026-02-19T21:01:17.351 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 115/177 2026-02-19T21:01:17.354 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 116/177 2026-02-19T21:01:17.368 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 117/177 2026-02-19T21:01:17.381 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-devel-3.12.12-3.el10_1.x86_64 118/177 2026-02-19T21:01:17.383 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-colorama-0.4.6-13.el10.noarch 119/177 2026-02-19T21:01:17.411 INFO:teuthology.orchestra.run.trial175.stdout:Transaction check succeeded. 2026-02-19T21:01:17.411 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction test 2026-02-19T21:01:17.436 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-0.3.29-2.el10.x86_64 120/177 2026-02-19T21:01:17.437 INFO:teuthology.orchestra.run.trial105.stdout:(30/175): rbd-mirror-20.3.0-5184.ga1ac97f8.el10 13 MB/s | 2.9 MB 00:00 2026-02-19T21:01:17.456 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 121/177 2026-02-19T21:01:17.457 INFO:teuthology.orchestra.run.trial105.stdout:(31/175): librgw2-20.3.0-5184.ga1ac97f8.el10.x8 16 MB/s | 6.7 MB 00:00 2026-02-19T21:01:17.458 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 122/177 2026-02-19T21:01:17.458 INFO:teuthology.orchestra.run.trial105.stdout:(32/175): rbd-nbd-20.3.0-5184.ga1ac97f8.el10.x8 8.6 MB/s | 179 kB 00:00 2026-02-19T21:01:17.459 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 123/177 2026-02-19T21:01:17.469 INFO:teuthology.orchestra.run.trial105.stdout:(33/175): ceph-grafana-dashboards-20.3.0-5184.g 4.8 MB/s | 57 kB 00:00 2026-02-19T21:01:17.470 INFO:teuthology.orchestra.run.trial105.stdout:(34/175): ceph-mgr-cephadm-20.3.0-5184.ga1ac97f 15 MB/s | 184 kB 00:00 2026-02-19T21:01:17.583 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 124/177 2026-02-19T21:01:17.608 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 125/177 2026-02-19T21:01:17.793 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 126/177 2026-02-19T21:01:17.800 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 127/177 2026-02-19T21:01:17.802 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libzstd-devel-1.5.5-9.el10.x86_64 128/177 2026-02-19T21:01:17.805 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libuuid-devel-2.40.2-15.el10_1.x86_64 129/177 2026-02-19T21:01:17.806 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cmake-filesystem-3.30.5-3.el10_0.x86_64 130/177 2026-02-19T21:01:17.808 INFO:teuthology.orchestra.run.trial090.stdout: Installing : zlib-ng-compat-devel-2.2.3-3.el10_1.x86_64 131/177 2026-02-19T21:01:17.814 INFO:teuthology.orchestra.run.trial090.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 132/177 2026-02-19T21:01:17.841 INFO:teuthology.orchestra.run.trial105.stdout:(35/175): ceph-mgr-diskprediction-local-20.3.0- 20 MB/s | 7.4 MB 00:00 2026-02-19T21:01:17.853 INFO:teuthology.orchestra.run.trial105.stdout:(36/175): ceph-mgr-k8sevents-20.3.0-5184.ga1ac9 1.8 MB/s | 22 kB 00:00 2026-02-19T21:01:17.876 INFO:teuthology.orchestra.run.trial105.stdout:(37/175): ceph-mgr-modules-core-20.3.0-5184.ga1 13 MB/s | 297 kB 00:00 2026-02-19T21:01:17.888 INFO:teuthology.orchestra.run.trial105.stdout:(38/175): ceph-mgr-rook-20.3.0-5184.ga1ac97f8.e 4.2 MB/s | 50 kB 00:00 2026-02-19T21:01:17.900 INFO:teuthology.orchestra.run.trial105.stdout:(39/175): ceph-prometheus-alerts-20.3.0-5184.ga 1.5 MB/s | 17 kB 00:00 2026-02-19T21:01:17.923 INFO:teuthology.orchestra.run.trial105.stdout:(40/175): ceph-volume-20.3.0-5184.ga1ac97f8.el1 16 MB/s | 374 kB 00:00 2026-02-19T21:01:17.990 INFO:teuthology.orchestra.run.trial105.stdout:(41/175): cephadm-20.3.0-5184.ga1ac97f8.el10.no 20 MB/s | 1.3 MB 00:00 2026-02-19T21:01:18.002 INFO:teuthology.orchestra.run.trial105.stdout:(42/175): cephfs-top-20.3.0-5184.ga1ac97f8.el10 1.5 MB/s | 18 kB 00:00 2026-02-19T21:01:18.023 INFO:teuthology.orchestra.run.trial090.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 133/177 2026-02-19T21:01:18.024 INFO:teuthology.orchestra.run.trial090.stdout: Installing : librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 134/177 2026-02-19T21:01:18.043 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 134/177 2026-02-19T21:01:18.044 INFO:teuthology.orchestra.run.trial090.stdout: Installing : python3-rgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 135/177 2026-02-19T21:01:18.065 INFO:teuthology.orchestra.run.trial105.stdout:(43/175): automake-1.16.5-20.el10.noarch.rpm 11 MB/s | 704 kB 00:00 2026-02-19T21:01:18.096 INFO:teuthology.orchestra.run.trial105.stdout:(44/175): bison-3.8.2-9.el10.x86_64.rpm 32 MB/s | 1.0 MB 00:00 2026-02-19T21:01:18.114 INFO:teuthology.orchestra.run.trial105.stdout:(45/175): boost-program-options-1.83.0-5.el10.x 6.1 MB/s | 109 kB 00:00 2026-02-19T21:01:18.126 INFO:teuthology.orchestra.run.trial105.stdout:(46/175): cmake-filesystem-3.30.5-3.el10_0.x86_ 1.2 MB/s | 15 kB 00:00 2026-02-19T21:01:18.140 INFO:teuthology.orchestra.run.trial105.stdout:(47/175): elfutils-libelf-devel-0.193-1.el10.ro 3.5 MB/s | 48 kB 00:00 2026-02-19T21:01:18.158 INFO:teuthology.orchestra.run.trial105.stdout:(48/175): flex-2.6.4-19.el10.x86_64.rpm 16 MB/s | 300 kB 00:00 2026-02-19T21:01:18.171 INFO:teuthology.orchestra.run.trial105.stdout:(49/175): flexiblas-3.4.2-3.el10.x86_64.rpm 1.9 MB/s | 25 kB 00:00 2026-02-19T21:01:18.234 INFO:teuthology.orchestra.run.trial105.stdout:(50/175): ceph-mgr-dashboard-20.3.0-5184.ga1ac9 20 MB/s | 15 MB 00:00 2026-02-19T21:01:18.239 INFO:teuthology.orchestra.run.trial105.stdout:(51/175): flexiblas-netlib-3.4.2-3.el10.x86_64. 47 MB/s | 3.2 MB 00:00 2026-02-19T21:01:18.246 INFO:teuthology.orchestra.run.trial105.stdout:(52/175): flexiblas-openblas-openmp-3.4.2-3.el1 1.4 MB/s | 17 kB 00:00 2026-02-19T21:01:18.253 INFO:teuthology.orchestra.run.trial105.stdout:(53/175): ledmon-libs-1.1.0-2.el10.x86_64.rpm 3.0 MB/s | 42 kB 00:00 2026-02-19T21:01:18.258 INFO:teuthology.orchestra.run.trial105.stdout:(54/175): libaio-devel-0.3.111-22.el10.x86_64.r 875 kB/s | 10 kB 00:00 2026-02-19T21:01:18.271 INFO:teuthology.orchestra.run.trial105.stdout:(55/175): libnbd-1.22.2-3.el10_1.x86_64.rpm 9.3 MB/s | 175 kB 00:00 2026-02-19T21:01:18.272 INFO:teuthology.orchestra.run.trial105.stdout:(56/175): librabbitmq-0.14.0-3.el10.x86_64.rpm 2.9 MB/s | 43 kB 00:00 2026-02-19T21:01:18.292 INFO:teuthology.orchestra.run.trial105.stdout:(57/175): librdkafka-2.1.1-7.el10.x86_64.rpm 35 MB/s | 725 kB 00:00 2026-02-19T21:01:18.292 INFO:teuthology.orchestra.run.trial105.stdout:(58/175): libstoragemgmt-1.10.1-4.el10.x86_64.r 12 MB/s | 251 kB 00:00 2026-02-19T21:01:18.306 INFO:teuthology.orchestra.run.trial105.stdout:(59/175): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 2.6 MB/s | 36 kB 00:00 2026-02-19T21:01:18.315 INFO:teuthology.orchestra.run.trial105.stdout:(60/175): libtool-2.4.7-13.el10.x86_64.rpm 25 MB/s | 601 kB 00:00 2026-02-19T21:01:18.318 INFO:teuthology.orchestra.run.trial105.stdout:(61/175): libuuid-devel-2.40.2-15.el10_1.x86_64 2.9 MB/s | 37 kB 00:00 2026-02-19T21:01:18.331 INFO:teuthology.orchestra.run.trial105.stdout:(62/175): libxslt-1.1.39-8.el10_0.x86_64.rpm 11 MB/s | 189 kB 00:00 2026-02-19T21:01:18.334 INFO:teuthology.orchestra.run.trial105.stdout:(63/175): libzstd-devel-1.5.5-9.el10.x86_64.rpm 3.3 MB/s | 51 kB 00:00 2026-02-19T21:01:18.347 INFO:teuthology.orchestra.run.trial105.stdout:(64/175): openblas-0.3.29-2.el10.x86_64.rpm 3.2 MB/s | 43 kB 00:00 2026-02-19T21:01:18.347 INFO:teuthology.orchestra.run.trial105.stdout:(65/175): lua-5.4.6-7.el10.x86_64.rpm 12 MB/s | 190 kB 00:00 2026-02-19T21:01:18.413 INFO:teuthology.orchestra.run.trial105.stdout:(66/175): openssl-devel-3.5.1-7.el10_1.x86_64.r 46 MB/s | 3.0 MB 00:00 2026-02-19T21:01:18.427 INFO:teuthology.orchestra.run.trial105.stdout:(67/175): perl-Thread-Queue-3.14-511.el10.noarc 1.5 MB/s | 21 kB 00:00 2026-02-19T21:01:18.438 INFO:teuthology.orchestra.run.trial105.stdout:(68/175): openblas-openmp-0.3.29-2.el10.x86_64. 58 MB/s | 5.3 MB 00:00 2026-02-19T21:01:18.443 INFO:teuthology.orchestra.run.trial105.stdout:(69/175): perl-threads-2.40-511.el10.x86_64.rpm 3.5 MB/s | 58 kB 00:00 2026-02-19T21:01:18.452 INFO:teuthology.orchestra.run.trial105.stdout:(70/175): perl-threads-shared-1.69-511.el10.x86 3.3 MB/s | 45 kB 00:00 2026-02-19T21:01:18.467 INFO:teuthology.orchestra.run.trial175.stdout:Transaction test succeeded. 2026-02-19T21:01:18.467 INFO:teuthology.orchestra.run.trial175.stdout:Running transaction 2026-02-19T21:01:18.479 INFO:teuthology.orchestra.run.trial105.stdout:(71/175): postgresql-contrib-16.11-1.el10_1.x86 38 MB/s | 1.0 MB 00:00 2026-02-19T21:01:18.484 INFO:teuthology.orchestra.run.trial105.stdout:(72/175): postgresql-16.11-1.el10_1.x86_64.rpm 48 MB/s | 2.0 MB 00:00 2026-02-19T21:01:18.496 INFO:teuthology.orchestra.run.trial105.stdout:(73/175): postgresql-private-libs-16.11-1.el10_ 8.1 MB/s | 143 kB 00:00 2026-02-19T21:01:18.524 INFO:teuthology.orchestra.run.trial105.stdout:(74/175): protobuf-3.19.6-11.el10.x86_64.rpm 36 MB/s | 1.0 MB 00:00 2026-02-19T21:01:18.541 INFO:teuthology.orchestra.run.trial105.stdout:(75/175): python3-colorama-0.4.6-13.el10.noarch 4.5 MB/s | 74 kB 00:00 2026-02-19T21:01:18.559 INFO:teuthology.orchestra.run.trial105.stdout:(76/175): python3-devel-3.12.12-3.el10_1.x86_64 17 MB/s | 329 kB 00:00 2026-02-19T21:01:18.581 INFO:teuthology.orchestra.run.trial105.stdout:(77/175): postgresql-server-16.11-1.el10_1.x86_ 72 MB/s | 7.0 MB 00:00 2026-02-19T21:01:18.586 INFO:teuthology.orchestra.run.trial105.stdout:(78/175): python3-jinja2-3.1.6-1.el10_0.noarch. 12 MB/s | 330 kB 00:00 2026-02-19T21:01:18.596 INFO:teuthology.orchestra.run.trial105.stdout:(79/175): python3-jmespath-1.0.1-8.el10.noarch. 4.0 MB/s | 60 kB 00:00 2026-02-19T21:01:18.601 INFO:teuthology.orchestra.run.trial105.stdout:(80/175): python3-libstoragemgmt-1.10.1-4.el10. 14 MB/s | 219 kB 00:00 2026-02-19T21:01:18.613 INFO:teuthology.orchestra.run.trial105.stdout:(81/175): python3-markupsafe-2.1.3-6.el10.x86_6 2.8 MB/s | 34 kB 00:00 2026-02-19T21:01:18.733 INFO:teuthology.orchestra.run.trial105.stdout:(82/175): python3-lxml-5.2.1-4.el10.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2026-02-19T21:01:18.751 INFO:teuthology.orchestra.run.trial105.stdout:(83/175): python3-numpy-f2py-1.26.4-5.el10.x86_ 27 MB/s | 490 kB 00:00 2026-02-19T21:01:18.766 INFO:teuthology.orchestra.run.trial105.stdout:(84/175): python3-prettytable-3.6.0-10.el10.noa 4.5 MB/s | 70 kB 00:00 2026-02-19T21:01:18.784 INFO:teuthology.orchestra.run.trial105.stdout:(85/175): python3-protobuf-3.19.6-11.el10.x86_6 23 MB/s | 419 kB 00:00 2026-02-19T21:01:18.802 INFO:teuthology.orchestra.run.trial105.stdout:(86/175): python3-pyasn1-0.6.1-1.el10.noarch.rp 11 MB/s | 198 kB 00:00 2026-02-19T21:01:18.820 INFO:teuthology.orchestra.run.trial105.stdout:(87/175): python3-pyasn1-modules-0.6.1-1.el10.n 22 MB/s | 402 kB 00:00 2026-02-19T21:01:18.833 INFO:teuthology.orchestra.run.trial105.stdout:(88/175): python3-requests-oauthlib-1.3.1-11.el 4.4 MB/s | 60 kB 00:00 2026-02-19T21:01:18.855 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:18.857 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:19.037 INFO:teuthology.orchestra.run.trial105.stdout:(89/175): python3-scipy-1.11.3-17.el10.x86_64.r 79 MB/s | 16 MB 00:00 2026-02-19T21:01:19.051 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:19.054 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 137/177 2026-02-19T21:01:19.054 INFO:teuthology.orchestra.run.trial105.stdout:(90/175): qatlib-24.09.0-2.el10.x86_64.rpm 13 MB/s | 229 kB 00:00 2026-02-19T21:01:19.067 INFO:teuthology.orchestra.run.trial105.stdout:(91/175): qatlib-service-24.09.0-2.el10.x86_64. 3.0 MB/s | 37 kB 00:00 2026-02-19T21:01:19.083 INFO:teuthology.orchestra.run.trial105.stdout:(92/175): qatzip-libs-1.3.1-1.el10.x86_64.rpm 3.9 MB/s | 66 kB 00:00 2026-02-19T21:01:19.084 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 137/177 2026-02-19T21:01:19.084 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-19T21:01:19.084 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-19T21:01:19.084 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:19.086 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 138/177 2026-02-19T21:01:19.103 INFO:teuthology.orchestra.run.trial105.stdout:(93/175): socat-1.7.4.4-8.el10.x86_64.rpm 15 MB/s | 303 kB 00:00 2026-02-19T21:01:19.120 INFO:teuthology.orchestra.run.trial105.stdout:(94/175): utf8proc-2.7.0-9.el10.x86_64.rpm 4.7 MB/s | 80 kB 00:00 2026-02-19T21:01:19.132 INFO:teuthology.orchestra.run.trial105.stdout:(95/175): uuid-1.6.2-65.el10.x86_64.rpm 4.7 MB/s | 59 kB 00:00 2026-02-19T21:01:19.148 INFO:teuthology.orchestra.run.trial105.stdout:(96/175): xfsprogs-devel-6.11.0-2.el10.x86_64.r 6.3 MB/s | 105 kB 00:00 2026-02-19T21:01:19.166 INFO:teuthology.orchestra.run.trial105.stdout:(97/175): xmlsec1-1.2.39-3.el10.x86_64.rpm 11 MB/s | 193 kB 00:00 2026-02-19T21:01:19.181 INFO:teuthology.orchestra.run.trial105.stdout:(98/175): xmlsec1-openssl-1.2.39-3.el10.x86_64. 6.2 MB/s | 96 kB 00:00 2026-02-19T21:01:19.195 INFO:teuthology.orchestra.run.trial105.stdout:(99/175): xmlstarlet-1.6.1-27.el10.x86_64.rpm 4.5 MB/s | 63 kB 00:00 2026-02-19T21:01:19.209 INFO:teuthology.orchestra.run.trial105.stdout:(100/175): zlib-ng-compat-devel-2.2.3-3.el10_1. 2.6 MB/s | 36 kB 00:00 2026-02-19T21:01:19.227 INFO:teuthology.orchestra.run.trial105.stdout:(101/175): cryptsetup-2.7.5-2.el10.x86_64.rpm 18 MB/s | 335 kB 00:00 2026-02-19T21:01:19.246 INFO:teuthology.orchestra.run.trial105.stdout:(102/175): daxctl-libs-80-4.el10.x86_64.rpm 2.1 MB/s | 42 kB 00:00 2026-02-19T21:01:19.265 INFO:teuthology.orchestra.run.trial105.stdout:(103/175): python3-numpy-1.26.4-5.el10.x86_64.r 10 MB/s | 6.7 MB 00:00 2026-02-19T21:01:19.266 INFO:teuthology.orchestra.run.trial105.stdout:(104/175): fuse3-3.16.2-5.el10.x86_64.rpm 2.9 MB/s | 58 kB 00:00 2026-02-19T21:01:19.283 INFO:teuthology.orchestra.run.trial105.stdout:(105/175): libconfig-1.7.3-10.el10.x86_64.rpm 4.1 MB/s | 72 kB 00:00 2026-02-19T21:01:19.308 INFO:teuthology.orchestra.run.trial105.stdout:(106/175): hwloc-libs-2.11.1-3.el10.x86_64.rpm 49 MB/s | 2.1 MB 00:00 2026-02-19T21:01:19.310 INFO:teuthology.orchestra.run.trial105.stdout:(107/175): libgfortran-14.3.1-2.1.el10.x86_64.r 31 MB/s | 827 kB 00:00 2026-02-19T21:01:19.322 INFO:teuthology.orchestra.run.trial105.stdout:(108/175): libpciaccess-0.16-16.el10.x86_64.rpm 1.9 MB/s | 27 kB 00:00 2026-02-19T21:01:19.327 INFO:teuthology.orchestra.run.trial105.stdout:(109/175): libquadmath-14.3.1-2.1.el10.x86_64.r 12 MB/s | 215 kB 00:00 2026-02-19T21:01:19.335 INFO:teuthology.orchestra.run.trial105.stdout:(110/175): mailcap-2.1.54-8.el10.noarch.rpm 2.5 MB/s | 34 kB 00:00 2026-02-19T21:01:19.343 INFO:teuthology.orchestra.run.trial105.stdout:(111/175): ndctl-libs-80-4.el10.x86_64.rpm 5.5 MB/s | 89 kB 00:00 2026-02-19T21:01:19.351 INFO:teuthology.orchestra.run.trial105.stdout:(112/175): ocl-icd-2.3.2-8.el10.x86_64.rpm 4.1 MB/s | 66 kB 00:00 2026-02-19T21:01:19.359 INFO:teuthology.orchestra.run.trial105.stdout:(113/175): pciutils-3.13.0-6.el10.x86_64.rpm 7.3 MB/s | 122 kB 00:00 2026-02-19T21:01:19.370 INFO:teuthology.orchestra.run.trial105.stdout:(114/175): python3-cffi-1.16.0-7.el10.x86_64.rp 16 MB/s | 310 kB 00:00 2026-02-19T21:01:19.385 INFO:teuthology.orchestra.run.trial105.stdout:(115/175): python3-packaging-24.2-2.el10.noarch 9.9 MB/s | 155 kB 00:00 2026-02-19T21:01:19.389 INFO:teuthology.orchestra.run.trial105.stdout:(116/175): python3-cryptography-43.0.0-4.el10.x 45 MB/s | 1.3 MB 00:00 2026-02-19T21:01:19.406 INFO:teuthology.orchestra.run.trial105.stdout:(117/175): python3-ply-3.11-25.el10.noarch.rpm 6.4 MB/s | 137 kB 00:00 2026-02-19T21:01:19.407 INFO:teuthology.orchestra.run.trial105.stdout:(118/175): python3-pycparser-2.20-16.el10.noarc 8.9 MB/s | 160 kB 00:00 2026-02-19T21:01:19.424 INFO:teuthology.orchestra.run.trial105.stdout:(119/175): python3-requests-2.32.4-1.el10_0.noa 9.1 MB/s | 160 kB 00:00 2026-02-19T21:01:19.425 INFO:teuthology.orchestra.run.trial105.stdout:(120/175): python3-urllib3-1.26.19-2.el10_1.1.n 16 MB/s | 285 kB 00:00 2026-02-19T21:01:19.442 INFO:teuthology.orchestra.run.trial105.stdout:(121/175): unzip-6.0-69.el10.x86_64.rpm 11 MB/s | 188 kB 00:00 2026-02-19T21:01:19.443 INFO:teuthology.orchestra.run.trial105.stdout:(122/175): zip-3.0-45.el10.x86_64.rpm 15 MB/s | 271 kB 00:00 2026-02-19T21:01:19.456 INFO:teuthology.orchestra.run.trial105.stdout:(123/175): lua-devel-5.4.6-7.el10.x86_64.rpm 1.6 MB/s | 22 kB 00:00 2026-02-19T21:01:19.460 INFO:teuthology.orchestra.run.trial105.stdout:(124/175): lttng-ust-2.13.7-5.el10.x86_64.rpm 17 MB/s | 334 kB 00:00 2026-02-19T21:01:19.474 INFO:teuthology.orchestra.run.trial105.stdout:(125/175): protobuf-compiler-3.19.6-11.el10.x86 44 MB/s | 787 kB 00:00 2026-02-19T21:01:19.590 INFO:teuthology.orchestra.run.trial175.stdout: Preparing : 1/1 2026-02-19T21:01:19.595 INFO:teuthology.orchestra.run.trial175.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 1/177 2026-02-19T21:01:19.599 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 2/177 2026-02-19T21:01:19.606 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 3/177 2026-02-19T21:01:19.721 INFO:teuthology.orchestra.run.trial175.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 4/177 2026-02-19T21:01:19.727 INFO:teuthology.orchestra.run.trial175.stdout: Upgrading : librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 5/177 2026-02-19T21:01:19.766 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 5/177 2026-02-19T21:01:19.767 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 6/177 2026-02-19T21:01:19.779 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 6/177 2026-02-19T21:01:19.781 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libcephfs-daemon-2:20.3.0-5184.ga1ac97f8.el10.x8 7/177 2026-02-19T21:01:19.782 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x8 8/177 2026-02-19T21:01:19.804 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x8 8/177 2026-02-19T21:01:19.810 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-rados-2:20.3.0-5184.ga1ac97f8.el10.x86_6 9/177 2026-02-19T21:01:19.812 INFO:teuthology.orchestra.run.trial175.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 10/177 2026-02-19T21:01:19.814 INFO:teuthology.orchestra.run.trial175.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 11/177 2026-02-19T21:01:19.820 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 12/177 2026-02-19T21:01:19.822 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 13/177 2026-02-19T21:01:19.824 INFO:teuthology.orchestra.run.trial175.stdout: Installing : daxctl-libs-80-4.el10.x86_64 14/177 2026-02-19T21:01:19.829 INFO:teuthology.orchestra.run.trial175.stdout: Installing : postgresql-private-libs-16.11-1.el10_1.x86_64 15/177 2026-02-19T21:01:19.861 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 16/177 2026-02-19T21:01:19.864 INFO:teuthology.orchestra.run.trial175.stdout: Installing : postgresql-16.11-1.el10_1.x86_64 17/177 2026-02-19T21:01:19.870 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ndctl-libs-80-4.el10.x86_64 18/177 2026-02-19T21:01:19.871 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_6 19/177 2026-02-19T21:01:19.889 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_6 19/177 2026-02-19T21:01:19.890 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x8 20/177 2026-02-19T21:01:19.922 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x8 20/177 2026-02-19T21:01:19.926 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 21/177 2026-02-19T21:01:19.928 INFO:teuthology.orchestra.run.trial175.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 22/177 2026-02-19T21:01:19.930 INFO:teuthology.orchestra.run.trial175.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 23/177 2026-02-19T21:01:19.954 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 24/177 2026-02-19T21:01:19.959 INFO:teuthology.orchestra.run.trial175.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 25/177 2026-02-19T21:01:19.962 INFO:teuthology.orchestra.run.trial175.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 26/177 2026-02-19T21:01:19.971 INFO:teuthology.orchestra.run.trial175.stdout: Installing : unzip-6.0-69.el10.x86_64 27/177 2026-02-19T21:01:19.977 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 28/177 2026-02-19T21:01:19.982 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 29/177 2026-02-19T21:01:19.991 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-packaging-24.2-2.el10.noarch 30/177 2026-02-19T21:01:19.994 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 31/177 2026-02-19T21:01:19.997 INFO:teuthology.orchestra.run.trial175.stdout: Installing : perl-threads-1:2.40-511.el10.x86_64 32/177 2026-02-19T21:01:19.999 INFO:teuthology.orchestra.run.trial175.stdout: Installing : lua-5.4.6-7.el10.x86_64 33/177 2026-02-19T21:01:20.002 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 34/177 2026-02-19T21:01:20.003 INFO:teuthology.orchestra.run.trial175.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 35/177 2026-02-19T21:01:20.020 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 36/177 2026-02-19T21:01:20.024 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-ceph-common-2:20.3.0-5184.ga1ac97f8.el10 37/177 2026-02-19T21:01:20.033 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-ceph-argparse-2:20.3.0-5184.ga1ac97f8.el 38/177 2026-02-19T21:01:20.034 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cephfs-2:20.3.0-5184.ga1ac97f8.el10.x86_ 39/177 2026-02-19T21:01:20.037 INFO:teuthology.orchestra.run.trial175.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 40/177 2026-02-19T21:01:20.038 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 41/177 2026-02-19T21:01:20.040 INFO:teuthology.orchestra.run.trial175.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 42/177 2026-02-19T21:01:20.042 INFO:teuthology.orchestra.run.trial175.stdout: Installing : perl-threads-shared-1.69-511.el10.x86_64 43/177 2026-02-19T21:01:20.052 INFO:teuthology.orchestra.run.trial175.stdout: Installing : perl-Thread-Queue-3.14-511.el10.noarch 44/177 2026-02-19T21:01:20.075 INFO:teuthology.orchestra.run.trial175.stdout: Installing : automake-1.16.5-20.el10.noarch 45/177 2026-02-19T21:01:20.081 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 46/177 2026-02-19T21:01:20.085 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 47/177 2026-02-19T21:01:20.089 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 48/177 2026-02-19T21:01:20.098 INFO:teuthology.orchestra.run.trial175.stdout: Installing : zip-3.0-45.el10.x86_64 49/177 2026-02-19T21:01:20.102 INFO:teuthology.orchestra.run.trial175.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 50/177 2026-02-19T21:01:20.104 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 51/177 2026-02-19T21:01:20.115 INFO:teuthology.orchestra.run.trial105.stdout:(126/175): ceph-test-20.3.0-5184.ga1ac97f8.el10 23 MB/s | 81 MB 00:03 2026-02-19T21:01:20.194 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 52/177 2026-02-19T21:01:20.195 INFO:teuthology.orchestra.run.trial175.stdout: Upgrading : librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 53/177 2026-02-19T21:01:20.219 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 53/177 2026-02-19T21:01:20.222 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-rbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 54/177 2026-02-19T21:01:20.224 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 55/177 2026-02-19T21:01:20.230 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 56/177 2026-02-19T21:01:20.232 INFO:teuthology.orchestra.run.trial175.stdout: Installing : librados-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_ 57/177 2026-02-19T21:01:20.244 INFO:teuthology.orchestra.run.trial175.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 58/177 2026-02-19T21:01:20.253 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 59/177 2026-02-19T21:01:20.257 INFO:teuthology.orchestra.run.trial175.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 60/177 2026-02-19T21:01:20.268 INFO:teuthology.orchestra.run.trial175.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 61/177 2026-02-19T21:01:20.270 INFO:teuthology.orchestra.run.trial175.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 62/177 2026-02-19T21:01:20.272 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 63/177 2026-02-19T21:01:20.278 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 64/177 2026-02-19T21:01:20.280 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 65/177 2026-02-19T21:01:20.285 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 66/177 2026-02-19T21:01:20.287 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 67/177 2026-02-19T21:01:20.298 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-pyperclip-1.8.2-1.el10_0.noarch 68/177 2026-02-19T21:01:20.302 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cmd2-2.5.8-1.el10_2.noarch 69/177 2026-02-19T21:01:20.305 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 70/177 2026-02-19T21:01:20.309 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 71/177 2026-02-19T21:01:20.315 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 72/177 2026-02-19T21:01:20.318 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 73/177 2026-02-19T21:01:20.320 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 74/177 2026-02-19T21:01:20.322 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 75/177 2026-02-19T21:01:20.336 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 76/177 2026-02-19T21:01:20.432 INFO:teuthology.orchestra.run.trial105.stdout:(127/175): grpc-data-1.48.4-44.el10_0.noarch.rp 66 kB/s | 21 kB 00:00 2026-02-19T21:01:20.471 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 77/177 2026-02-19T21:01:20.478 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 78/177 2026-02-19T21:01:20.481 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 79/177 2026-02-19T21:01:20.484 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 80/177 2026-02-19T21:01:20.486 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 81/177 2026-02-19T21:01:20.488 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 82/177 2026-02-19T21:01:20.493 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 83/177 2026-02-19T21:01:20.495 INFO:teuthology.orchestra.run.trial175.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 84/177 2026-02-19T21:01:20.518 INFO:teuthology.orchestra.run.trial175.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 85/177 2026-02-19T21:01:20.523 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 86/177 2026-02-19T21:01:20.527 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 87/177 2026-02-19T21:01:20.533 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-ply-3.11-25.el10.noarch 88/177 2026-02-19T21:01:20.540 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 89/177 2026-02-19T21:01:20.571 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 90/177 2026-02-19T21:01:20.576 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 91/177 2026-02-19T21:01:20.585 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 92/177 2026-02-19T21:01:20.597 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 93/177 2026-02-19T21:01:20.617 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 94/177 2026-02-19T21:01:20.621 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 95/177 2026-02-19T21:01:20.623 INFO:teuthology.orchestra.run.trial175.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 96/177 2026-02-19T21:01:20.624 INFO:teuthology.orchestra.run.trial175.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 97/177 2026-02-19T21:01:20.633 INFO:teuthology.orchestra.run.trial105.stdout:(128/175): abseil-cpp-20240722.1-1.el10_0.x86_6 503 kB/s | 590 kB 00:01 2026-02-19T21:01:20.639 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 97/177 2026-02-19T21:01:20.656 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 98/177 2026-02-19T21:01:20.660 INFO:teuthology.orchestra.run.trial175.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 98/177 2026-02-19T21:01:20.663 INFO:teuthology.orchestra.run.trial175.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 99/177 2026-02-19T21:01:20.665 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 100/177 2026-02-19T21:01:20.667 INFO:teuthology.orchestra.run.trial175.stdout: Installing : mailcap-2.1.54-8.el10.noarch 101/177 2026-02-19T21:01:20.669 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 102/177 2026-02-19T21:01:20.676 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 103/177 2026-02-19T21:01:20.679 INFO:teuthology.orchestra.run.trial175.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 104/177 2026-02-19T21:01:20.680 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 105/177 2026-02-19T21:01:20.699 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:20.699 INFO:teuthology.orchestra.run.trial175.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-19T21:01:20.699 INFO:teuthology.orchestra.run.trial175.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-19T21:01:20.700 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:20.706 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:20.713 INFO:teuthology.orchestra.run.trial105.stdout:(129/175): libarrow-doc-17.0.0-9.el10_2.noarch. 333 kB/s | 27 kB 00:00 2026-02-19T21:01:20.728 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:20.729 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-19T21:01:20.729 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:20.738 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 107/177 2026-02-19T21:01:20.746 INFO:teuthology.orchestra.run.trial175.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 108/177 2026-02-19T21:01:20.750 INFO:teuthology.orchestra.run.trial175.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 109/177 2026-02-19T21:01:20.753 INFO:teuthology.orchestra.run.trial175.stdout: Installing : uuid-1.6.2-65.el10.x86_64 110/177 2026-02-19T21:01:20.792 INFO:teuthology.orchestra.run.trial175.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 111/177 2026-02-19T21:01:20.797 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 112/177 2026-02-19T21:01:20.800 INFO:teuthology.orchestra.run.trial175.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 113/177 2026-02-19T21:01:20.801 INFO:teuthology.orchestra.run.trial105.stdout:(130/175): liboath-2.6.12-1.el10_0.x86_64.rpm 550 kB/s | 48 kB 00:00 2026-02-19T21:01:20.802 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 114/177 2026-02-19T21:01:20.810 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 115/177 2026-02-19T21:01:20.814 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 116/177 2026-02-19T21:01:20.828 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 117/177 2026-02-19T21:01:20.841 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-devel-3.12.12-3.el10_1.x86_64 118/177 2026-02-19T21:01:20.842 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-colorama-0.4.6-13.el10.noarch 119/177 2026-02-19T21:01:20.897 INFO:teuthology.orchestra.run.trial175.stdout: Installing : openblas-0.3.29-2.el10.x86_64 120/177 2026-02-19T21:01:20.916 INFO:teuthology.orchestra.run.trial175.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 121/177 2026-02-19T21:01:20.917 INFO:teuthology.orchestra.run.trial175.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 122/177 2026-02-19T21:01:20.919 INFO:teuthology.orchestra.run.trial175.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 123/177 2026-02-19T21:01:21.043 INFO:teuthology.orchestra.run.trial175.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 124/177 2026-02-19T21:01:21.068 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 125/177 2026-02-19T21:01:21.251 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 126/177 2026-02-19T21:01:21.258 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 127/177 2026-02-19T21:01:21.259 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libzstd-devel-1.5.5-9.el10.x86_64 128/177 2026-02-19T21:01:21.262 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libuuid-devel-2.40.2-15.el10_1.x86_64 129/177 2026-02-19T21:01:21.264 INFO:teuthology.orchestra.run.trial175.stdout: Installing : cmake-filesystem-3.30.5-3.el10_0.x86_64 130/177 2026-02-19T21:01:21.265 INFO:teuthology.orchestra.run.trial175.stdout: Installing : zlib-ng-compat-devel-2.2.3-3.el10_1.x86_64 131/177 2026-02-19T21:01:21.271 INFO:teuthology.orchestra.run.trial175.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 132/177 2026-02-19T21:01:21.481 INFO:teuthology.orchestra.run.trial175.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 133/177 2026-02-19T21:01:21.482 INFO:teuthology.orchestra.run.trial175.stdout: Installing : librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 134/177 2026-02-19T21:01:21.501 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 134/177 2026-02-19T21:01:21.502 INFO:teuthology.orchestra.run.trial175.stdout: Installing : python3-rgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 135/177 2026-02-19T21:01:22.196 INFO:teuthology.orchestra.run.trial105.stdout:(131/175): gperftools-libs-2.15-4.el10_0.x86_64 111 kB/s | 303 kB 00:02 2026-02-19T21:01:22.307 INFO:teuthology.orchestra.run.trial105.stdout:(132/175): liborc2-2.0.7-1.el10_2.x86_64.rpm 342 kB/s | 515 kB 00:01 2026-02-19T21:01:22.312 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:22.314 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:22.354 INFO:teuthology.orchestra.run.trial105.stdout:(133/175): libpmem-2.1.0-2.el10_0.x86_64.rpm 711 kB/s | 112 kB 00:00 2026-02-19T21:01:22.512 INFO:teuthology.orchestra.run.trial105.stdout:(134/175): libunwind-1.8.0-4.el10_0.x86_64.rpm 460 kB/s | 73 kB 00:00 2026-02-19T21:01:22.514 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:22.517 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 137/177 2026-02-19T21:01:22.549 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 137/177 2026-02-19T21:01:22.549 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-19T21:01:22.550 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-19T21:01:22.550 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:22.550 INFO:teuthology.orchestra.run.trial105.stdout:(135/175): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 662 kB/s | 161 kB 00:00 2026-02-19T21:01:22.551 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 138/177 2026-02-19T21:01:22.748 INFO:teuthology.orchestra.run.trial105.stdout:(136/175): luarocks-3.9.2-6.el10_0.noarch.rpm 643 kB/s | 152 kB 00:00 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 138/177 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /sys 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /proc 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /mnt 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /var/tmp 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /home 2026-02-19T21:01:23.169 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /root 2026-02-19T21:01:23.170 INFO:teuthology.orchestra.run.trial090.stdout:skipping the directory /tmp 2026-02-19T21:01:23.170 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:23.620 INFO:teuthology.orchestra.run.trial105.stdout:(137/175): python3-asyncssh-2.17.0-1.el10_0.noa 867 kB/s | 756 kB 00:00 2026-02-19T21:01:23.705 INFO:teuthology.orchestra.run.trial105.stdout:(138/175): python3-autocommand-2.2.2-9.el10_0.n 371 kB/s | 32 kB 00:00 2026-02-19T21:01:23.772 INFO:teuthology.orchestra.run.trial105.stdout:(139/175): parquet-libs-17.0.0-9.el10_2.x86_64. 835 kB/s | 1.0 MB 00:01 2026-02-19T21:01:23.860 INFO:teuthology.orchestra.run.trial105.stdout:(140/175): python3-cachetools-5.4.0-6.el10_0.no 417 kB/s | 37 kB 00:00 2026-02-19T21:01:23.996 INFO:teuthology.orchestra.run.trial105.stdout:(141/175): python3-certifi-2023.05.07-6.el10_0. 106 kB/s | 14 kB 00:00 2026-02-19T21:01:24.023 INFO:teuthology.orchestra.run.trial105.stdout:(142/175): python3-bcrypt-4.3.0-3.el10_1.x86_64 750 kB/s | 238 kB 00:00 2026-02-19T21:01:24.248 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x8 139/177 2026-02-19T21:01:24.277 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x8 140/177 2026-02-19T21:01:24.279 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 141/177 2026-02-19T21:01:24.296 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 141/177 2026-02-19T21:01:24.296 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:24.296 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-19T21:01:24.296 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:24.304 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 142/177 2026-02-19T21:01:24.330 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 142/177 2026-02-19T21:01:24.330 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:24.330 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-19T21:01:24.330 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-19T21:01:24.331 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-19T21:01:24.331 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:24.340 INFO:teuthology.orchestra.run.trial105.stdout:(143/175): python3-cheroot-10.0.1-4.el10_0.noar 626 kB/s | 215 kB 00:00 2026-02-19T21:01:24.405 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 143/177 2026-02-19T21:01:24.428 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 143/177 2026-02-19T21:01:24.428 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:24.428 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-19T21:01:24.428 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-19T21:01:24.428 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-19T21:01:24.428 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:24.507 INFO:teuthology.orchestra.run.trial105.stdout:(144/175): python3-cherrypy-18.10.0-4.el10_0.no 741 kB/s | 359 kB 00:00 2026-02-19T21:01:24.595 INFO:teuthology.orchestra.run.trial105.stdout:(145/175): python3-durationpy-0.9-2.el10_0.noar 168 kB/s | 15 kB 00:00 2026-02-19T21:01:24.616 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 144/177 2026-02-19T21:01:24.640 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 144/177 2026-02-19T21:01:24.640 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:24.640 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-19T21:01:24.640 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-19T21:01:24.640 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-19T21:01:24.640 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:24.675 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 145/177 2026-02-19T21:01:24.676 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 145/177 2026-02-19T21:01:24.684 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5184.ga1ac97f8.e 146/177 2026-02-19T21:01:24.696 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5184.ga1ac97f8. 147/177 2026-02-19T21:01:24.697 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.no 148/177 2026-02-19T21:01:24.828 INFO:teuthology.orchestra.run.trial105.stdout:(146/175): python3-cmd2-2.5.8-1.el10_2.noarch.r 769 kB/s | 375 kB 00:00 2026-02-19T21:01:25.000 INFO:teuthology.orchestra.run.trial105.stdout:(147/175): python3-google-auth-2.40.3-1.el10_1. 705 kB/s | 286 kB 00:00 2026-02-19T21:01:25.243 INFO:teuthology.orchestra.run.trial105.stdout:(148/175): python3-grpcio-tools-1.48.4-44.el10_ 647 kB/s | 157 kB 00:00 2026-02-19T21:01:25.332 INFO:teuthology.orchestra.run.trial105.stdout:(149/175): python3-isodate-0.6.1-14.el10_0.noar 747 kB/s | 66 kB 00:00 2026-02-19T21:01:25.415 INFO:teuthology.orchestra.run.trial105.stdout:(150/175): python3-jaraco-collections-5.1.0-1.e 350 kB/s | 29 kB 00:00 2026-02-19T21:01:25.502 INFO:teuthology.orchestra.run.trial105.stdout:(151/175): python3-jaraco-context-6.0.1-4.el10_ 245 kB/s | 21 kB 00:00 2026-02-19T21:01:25.582 INFO:teuthology.orchestra.run.trial105.stdout:(152/175): python3-jaraco-functools-4.0.2-4.el1 282 kB/s | 23 kB 00:00 2026-02-19T21:01:25.599 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.no 148/177 2026-02-19T21:01:25.605 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10. 149/177 2026-02-19T21:01:25.672 INFO:teuthology.orchestra.run.trial105.stdout:(153/175): python3-jaraco-text-4.0.0-3.el10_0.n 324 kB/s | 29 kB 00:00 2026-02-19T21:01:25.959 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10. 149/177 2026-02-19T21:01:25.960 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1a 150/177 2026-02-19T21:01:25.971 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1a 150/177 2026-02-19T21:01:25.971 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10. 151/177 2026-02-19T21:01:26.005 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10. 151/177 2026-02-19T21:01:26.037 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5184.ga1ac97f8.el 152/177 2026-02-19T21:01:26.038 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 153/177 2026-02-19T21:01:26.062 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 153/177 2026-02-19T21:01:26.062 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:26.062 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-19T21:01:26.062 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-19T21:01:26.062 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-19T21:01:26.062 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:26.069 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarc 154/177 2026-02-19T21:01:26.081 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarc 154/177 2026-02-19T21:01:26.513 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-2:20.3.0-5184.ga1ac97f8.el10.x86_64 155/177 2026-02-19T21:01:26.515 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 156/177 2026-02-19T21:01:26.538 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 156/177 2026-02-19T21:01:26.539 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:26.539 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-19T21:01:26.539 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-19T21:01:26.539 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-19T21:01:26.539 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:26.546 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5184.ga1ac9 157/177 2026-02-19T21:01:26.568 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5184.ga1ac9 157/177 2026-02-19T21:01:26.568 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:26.569 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-19T21:01:26.569 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:26.578 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_6 158/177 2026-02-19T21:01:26.599 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_6 158/177 2026-02-19T21:01:26.600 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:26.600 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-19T21:01:26.600 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-19T21:01:26.600 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-19T21:01:26.600 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 138/177 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /sys 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /proc 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /mnt 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /var/tmp 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /home 2026-02-19T21:01:26.609 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /root 2026-02-19T21:01:26.610 INFO:teuthology.orchestra.run.trial175.stdout:skipping the directory /tmp 2026-02-19T21:01:26.610 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:26.694 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 159/177 2026-02-19T21:01:26.715 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 159/177 2026-02-19T21:01:26.715 INFO:teuthology.orchestra.run.trial090.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:26.715 INFO:teuthology.orchestra.run.trial090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-19T21:01:26.715 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-19T21:01:26.716 INFO:teuthology.orchestra.run.trial090.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-19T21:01:26.716 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:27.095 INFO:teuthology.orchestra.run.trial105.stdout:(154/175): libarrow-17.0.0-9.el10_2.x86_64.rpm 871 kB/s | 5.7 MB 00:06 2026-02-19T21:01:27.253 INFO:teuthology.orchestra.run.trial105.stdout:(155/175): python3-kubernetes-32.0.1-1.el10_1.n 865 kB/s | 1.3 MB 00:01 2026-02-19T21:01:27.285 INFO:teuthology.orchestra.run.trial105.stdout:(156/175): python3-more-itertools-10.1.0-8.el10 530 kB/s | 100 kB 00:00 2026-02-19T21:01:27.372 INFO:teuthology.orchestra.run.trial105.stdout:(157/175): python3-portend-3.2.0-6.el10_0.noarc 203 kB/s | 18 kB 00:00 2026-02-19T21:01:27.421 INFO:teuthology.orchestra.run.trial105.stdout:(158/175): python3-natsort-8.4.0-2.el10_0.noarc 428 kB/s | 72 kB 00:00 2026-02-19T21:01:27.509 INFO:teuthology.orchestra.run.trial105.stdout:(159/175): python3-pyperclip-1.8.2-1.el10_0.noa 318 kB/s | 28 kB 00:00 2026-02-19T21:01:27.536 INFO:teuthology.orchestra.run.trial105.stdout:(160/175): python3-pyOpenSSL-25.0.0-1.el10_1.no 690 kB/s | 113 kB 00:00 2026-02-19T21:01:27.545 INFO:teuthology.orchestra.run.trial105.stdout:(161/175): python3-grpcio-1.48.4-44.el10_0.x86_ 869 kB/s | 2.3 MB 00:02 2026-02-19T21:01:27.598 INFO:teuthology.orchestra.run.trial105.stdout:(162/175): python3-repoze-lru-0.7-23.el10_0.noa 404 kB/s | 36 kB 00:00 2026-02-19T21:01:27.634 INFO:teuthology.orchestra.run.trial105.stdout:(163/175): python3-rsa-4.9-7.el10_0.noarch.rpm 787 kB/s | 70 kB 00:00 2026-02-19T21:01:27.682 INFO:teuthology.orchestra.run.trial105.stdout:(164/175): python3-tempora-5.7.0-1.el10_0.noarc 441 kB/s | 37 kB 00:00 2026-02-19T21:01:27.686 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x8 139/177 2026-02-19T21:01:27.715 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x8 140/177 2026-02-19T21:01:27.716 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 141/177 2026-02-19T21:01:27.731 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 141/177 2026-02-19T21:01:27.731 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:27.731 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-19T21:01:27.731 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:27.738 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 142/177 2026-02-19T21:01:27.762 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 142/177 2026-02-19T21:01:27.762 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:27.762 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-19T21:01:27.762 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-19T21:01:27.762 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-19T21:01:27.763 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:27.769 INFO:teuthology.orchestra.run.trial105.stdout:(165/175): python3-xmltodict-0.13.0-5.el10_0.no 300 kB/s | 26 kB 00:00 2026-02-19T21:01:27.807 INFO:teuthology.orchestra.run.trial105.stdout:(166/175): python3-routes-2.5.1-11.el10_0.noarc 745 kB/s | 201 kB 00:00 2026-02-19T21:01:27.819 INFO:teuthology.orchestra.run.trial105.stdout:(167/175): python3-websocket-client-1.8.0-2.el1 675 kB/s | 124 kB 00:00 2026-02-19T21:01:27.836 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 143/177 2026-02-19T21:01:27.854 INFO:teuthology.orchestra.run.trial105.stdout:(168/175): python3-zc-lockfile-3.0.post1-11.el1 268 kB/s | 23 kB 00:00 2026-02-19T21:01:27.859 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 143/177 2026-02-19T21:01:27.859 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:27.859 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-19T21:01:27.859 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-19T21:01:27.859 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-19T21:01:27.859 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:28.044 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 144/177 2026-02-19T21:01:28.045 INFO:teuthology.orchestra.run.trial105.stdout:(169/175): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rp 666 kB/s | 127 kB 00:00 2026-02-19T21:01:28.067 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 144/177 2026-02-19T21:01:28.067 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:28.067 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-19T21:01:28.067 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-19T21:01:28.068 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-19T21:01:28.068 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:28.075 INFO:teuthology.orchestra.run.trial105.stdout:(170/175): python3-saml-1.16.0-11.el10.noarch.r 4.9 MB/s | 150 kB 00:00 2026-02-19T21:01:28.077 INFO:teuthology.orchestra.run.trial105.stdout:(171/175): python3-xmlsec-1.3.16-1.el10.x86_64. 32 MB/s | 49 kB 00:00 2026-02-19T21:01:28.102 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 145/177 2026-02-19T21:01:28.103 INFO:teuthology.orchestra.run.trial175.stdout: Installing : cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 145/177 2026-02-19T21:01:28.111 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5184.ga1ac97f8.e 146/177 2026-02-19T21:01:28.122 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5184.ga1ac97f8. 147/177 2026-02-19T21:01:28.123 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.no 148/177 2026-02-19T21:01:28.130 INFO:teuthology.orchestra.run.trial105.stdout:(172/175): re2-20251105-1.el10_2.x86_64.rpm 685 kB/s | 221 kB 00:00 2026-02-19T21:01:28.272 INFO:teuthology.orchestra.run.trial105.stdout:(173/175): librados2-20.3.0-5184.ga1ac97f8.el10 19 MB/s | 3.6 MB 00:00 2026-02-19T21:01:28.291 INFO:teuthology.orchestra.run.trial105.stdout:(174/175): librbd1-20.3.0-5184.ga1ac97f8.el10.x 18 MB/s | 2.8 MB 00:00 2026-02-19T21:01:29.025 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.no 148/177 2026-02-19T21:01:29.030 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10. 149/177 2026-02-19T21:01:29.318 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-test-2:20.3.0-5184.ga1ac97f8.el10.x86_64 160/177 2026-02-19T21:01:29.322 INFO:teuthology.orchestra.run.trial090.stdout: Installing : elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86 161/177 2026-02-19T21:01:29.324 INFO:teuthology.orchestra.run.trial090.stdout: Installing : xfsprogs-devel-6.11.0-2.el10.x86_64 162/177 2026-02-19T21:01:29.356 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephfs-shell-2:20.3.0-5184.ga1ac97f8.el10.x86_64 163/177 2026-02-19T21:01:29.385 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10. 149/177 2026-02-19T21:01:29.386 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1a 150/177 2026-02-19T21:01:29.391 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-contrib-16.11-1.el10_1.x86_64 164/177 2026-02-19T21:01:29.393 INFO:teuthology.orchestra.run.trial090.stdout: Installing : ceph-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 165/177 2026-02-19T21:01:29.396 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1a 150/177 2026-02-19T21:01:29.397 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libcephfs-devel-2:20.3.0-5184.ga1ac97f8.el10.x86 166/177 2026-02-19T21:01:29.397 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10. 151/177 2026-02-19T21:01:29.403 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 167/177 2026-02-19T21:01:29.410 INFO:teuthology.orchestra.run.trial090.stdout: Installing : rbd-nbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 168/177 2026-02-19T21:01:29.411 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libtool-2.4.7-13.el10.x86_64 169/177 2026-02-19T21:01:29.429 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10. 151/177 2026-02-19T21:01:29.462 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5184.ga1ac97f8.el 152/177 2026-02-19T21:01:29.463 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 153/177 2026-02-19T21:01:29.486 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 153/177 2026-02-19T21:01:29.486 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:29.486 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-19T21:01:29.486 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-19T21:01:29.486 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-19T21:01:29.486 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:29.492 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarc 154/177 2026-02-19T21:01:29.496 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:29.499 INFO:teuthology.orchestra.run.trial090.stdout: Installing : postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:29.503 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarc 154/177 2026-02-19T21:01:29.515 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:29.748 INFO:teuthology.orchestra.run.trial090.stdout: Installing : cephfs-top-2:20.3.0-5184.ga1ac97f8.el10.noarch 171/177 2026-02-19T21:01:29.758 INFO:teuthology.orchestra.run.trial090.stdout: Installing : openssl-devel-1:3.5.1-7.el10_1.x86_64 172/177 2026-02-19T21:01:29.763 INFO:teuthology.orchestra.run.trial090.stdout: Installing : libaio-devel-0.3.111-22.el10.x86_64 173/177 2026-02-19T21:01:29.777 INFO:teuthology.orchestra.run.trial090.stdout: Installing : flex-2.6.4-19.el10.x86_64 174/177 2026-02-19T21:01:29.780 INFO:teuthology.orchestra.run.trial090.stdout: Installing : bison-3.8.2-9.el10.x86_64 175/177 2026-02-19T21:01:29.781 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 176/177 2026-02-19T21:01:29.782 INFO:teuthology.orchestra.run.trial090.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 177/177 2026-02-19T21:01:29.790 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x8 177/177 2026-02-19T21:01:29.801 INFO:teuthology.orchestra.run.trial105.stdout:(175/175): thrift-0.20.0-4.el10_1.x86_64.rpm 866 kB/s | 1.7 MB 00:01 2026-02-19T21:01:29.803 INFO:teuthology.orchestra.run.trial105.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:01:29.803 INFO:teuthology.orchestra.run.trial105.stdout:Total 14 MB/s | 298 MB 00:21 2026-02-19T21:01:29.804 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction check 2026-02-19T21:01:29.817 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x8 177/177 2026-02-19T21:01:29.867 INFO:teuthology.orchestra.run.trial105.stdout:Transaction check succeeded. 2026-02-19T21:01:29.867 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction test 2026-02-19T21:01:29.938 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-2:20.3.0-5184.ga1ac97f8.el10.x86_64 155/177 2026-02-19T21:01:29.940 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 156/177 2026-02-19T21:01:29.962 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 156/177 2026-02-19T21:01:29.962 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:29.962 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-19T21:01:29.962 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-19T21:01:29.962 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-19T21:01:29.963 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:29.968 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5184.ga1ac9 157/177 2026-02-19T21:01:29.989 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5184.ga1ac9 157/177 2026-02-19T21:01:29.989 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:29.989 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-19T21:01:29.989 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:29.999 INFO:teuthology.orchestra.run.trial175.stdout: Installing : cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_6 158/177 2026-02-19T21:01:30.020 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_6 158/177 2026-02-19T21:01:30.020 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:30.021 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-19T21:01:30.021 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-19T21:01:30.021 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-19T21:01:30.021 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:30.113 INFO:teuthology.orchestra.run.trial175.stdout: Installing : rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 159/177 2026-02-19T21:01:30.134 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 159/177 2026-02-19T21:01:30.134 INFO:teuthology.orchestra.run.trial175.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:30.134 INFO:teuthology.orchestra.run.trial175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-19T21:01:30.135 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-19T21:01:30.135 INFO:teuthology.orchestra.run.trial175.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-19T21:01:30.135 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:30.923 INFO:teuthology.orchestra.run.trial105.stdout:Transaction test succeeded. 2026-02-19T21:01:30.924 INFO:teuthology.orchestra.run.trial105.stdout:Running transaction 2026-02-19T21:01:30.991 INFO:teuthology.orchestra.run.trial090.stdout: Running scriptlet: librados2-2:18.2.1-4.el10.x86_64 177/177 2026-02-19T21:01:30.991 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:30.991 INFO:teuthology.orchestra.run.trial090.stdout:Upgraded: 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout:Installed: 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: automake-1.16.5-20.el10.noarch 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: bison-3.8.2-9.el10.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: ceph-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.992 INFO:teuthology.orchestra.run.trial090.stdout: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-grafana-dashboards-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-immutable-object-cache-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.993 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-modules-core-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-prometheus-alerts-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-test-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.994 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-shell-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: cephfs-top-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: cmake-filesystem-3.30.5-3.el10_0.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: flex-2.6.4-19.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: fuse3-3.16.2-5.el10.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-19T21:01:30.995 INFO:teuthology.orchestra.run.trial090.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libaio-devel-0.3.111-22.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-daemon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-19T21:01:30.996 INFO:teuthology.orchestra.run.trial090.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: librados-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:30.997 INFO:teuthology.orchestra.run.trial090.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: libtool-2.4.7-13.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: libuuid-devel-2.40.2-15.el10_1.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: libzstd-devel-1.5.5-9.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: lua-5.4.6-7.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-19T21:01:30.998 INFO:teuthology.orchestra.run.trial090.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: openssl-devel-1:3.5.1-7.el10_1.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: perl-Thread-Queue-3.14-511.el10.noarch 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads-1:2.40-511.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: perl-threads-shared-1.69-511.el10.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-16.11-1.el10_1.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-contrib-16.11-1.el10_1.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-private-libs-16.11-1.el10_1.x86_64 2026-02-19T21:01:30.999 INFO:teuthology.orchestra.run.trial090.stdout: postgresql-server-16.11-1.el10_1.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-argparse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-cephfs-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-19T21:01:31.000 INFO:teuthology.orchestra.run.trial090.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-cmd2-2.5.8-1.el10_2.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-colorama-0.4.6-13.el10.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-devel-3.12.12-3.el10_1.x86_64 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-19T21:01:31.001 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-19T21:01:31.002 INFO:teuthology.orchestra.run.trial090.stdout: python3-ply-3.11-25.el10.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-pyperclip-1.8.2-1.el10_0.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-rados-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-rbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-19T21:01:31.003 INFO:teuthology.orchestra.run.trial090.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-rgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-19T21:01:31.004 INFO:teuthology.orchestra.run.trial090.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: rbd-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: rbd-nbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: unzip-6.0-69.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: uuid-1.6.2-65.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: xfsprogs-devel-6.11.0-2.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-19T21:01:31.005 INFO:teuthology.orchestra.run.trial090.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-19T21:01:31.006 INFO:teuthology.orchestra.run.trial090.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-19T21:01:31.006 INFO:teuthology.orchestra.run.trial090.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-19T21:01:31.006 INFO:teuthology.orchestra.run.trial090.stdout: zip-3.0-45.el10.x86_64 2026-02-19T21:01:31.006 INFO:teuthology.orchestra.run.trial090.stdout: zlib-ng-compat-devel-2.2.3-3.el10_1.x86_64 2026-02-19T21:01:31.006 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:01:31.006 INFO:teuthology.orchestra.run.trial090.stdout:Complete! 2026-02-19T21:01:31.073 DEBUG:teuthology.parallel:result is None 2026-02-19T21:01:32.049 INFO:teuthology.orchestra.run.trial105.stdout: Preparing : 1/1 2026-02-19T21:01:32.053 INFO:teuthology.orchestra.run.trial105.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 1/177 2026-02-19T21:01:32.057 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 2/177 2026-02-19T21:01:32.065 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 3/177 2026-02-19T21:01:32.180 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 4/177 2026-02-19T21:01:32.184 INFO:teuthology.orchestra.run.trial105.stdout: Upgrading : librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 5/177 2026-02-19T21:01:32.225 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 5/177 2026-02-19T21:01:32.226 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 6/177 2026-02-19T21:01:32.237 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 6/177 2026-02-19T21:01:32.239 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs-daemon-2:20.3.0-5184.ga1ac97f8.el10.x8 7/177 2026-02-19T21:01:32.240 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x8 8/177 2026-02-19T21:01:32.262 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x8 8/177 2026-02-19T21:01:32.269 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rados-2:20.3.0-5184.ga1ac97f8.el10.x86_6 9/177 2026-02-19T21:01:32.270 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 10/177 2026-02-19T21:01:32.272 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 11/177 2026-02-19T21:01:32.279 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 12/177 2026-02-19T21:01:32.280 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 13/177 2026-02-19T21:01:32.283 INFO:teuthology.orchestra.run.trial105.stdout: Installing : daxctl-libs-80-4.el10.x86_64 14/177 2026-02-19T21:01:32.286 INFO:teuthology.orchestra.run.trial105.stdout: Installing : postgresql-private-libs-16.11-1.el10_1.x86_64 15/177 2026-02-19T21:01:32.317 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 16/177 2026-02-19T21:01:32.321 INFO:teuthology.orchestra.run.trial105.stdout: Installing : postgresql-16.11-1.el10_1.x86_64 17/177 2026-02-19T21:01:32.326 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ndctl-libs-80-4.el10.x86_64 18/177 2026-02-19T21:01:32.327 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_6 19/177 2026-02-19T21:01:32.347 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_6 19/177 2026-02-19T21:01:32.348 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x8 20/177 2026-02-19T21:01:32.379 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x8 20/177 2026-02-19T21:01:32.382 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 21/177 2026-02-19T21:01:32.384 INFO:teuthology.orchestra.run.trial105.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 22/177 2026-02-19T21:01:32.386 INFO:teuthology.orchestra.run.trial105.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 23/177 2026-02-19T21:01:32.408 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 24/177 2026-02-19T21:01:32.413 INFO:teuthology.orchestra.run.trial105.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 25/177 2026-02-19T21:01:32.416 INFO:teuthology.orchestra.run.trial105.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 26/177 2026-02-19T21:01:32.426 INFO:teuthology.orchestra.run.trial105.stdout: Installing : unzip-6.0-69.el10.x86_64 27/177 2026-02-19T21:01:32.431 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 28/177 2026-02-19T21:01:32.437 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 29/177 2026-02-19T21:01:32.445 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-packaging-24.2-2.el10.noarch 30/177 2026-02-19T21:01:32.448 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 31/177 2026-02-19T21:01:32.451 INFO:teuthology.orchestra.run.trial105.stdout: Installing : perl-threads-1:2.40-511.el10.x86_64 32/177 2026-02-19T21:01:32.453 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lua-5.4.6-7.el10.x86_64 33/177 2026-02-19T21:01:32.456 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 34/177 2026-02-19T21:01:32.457 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 35/177 2026-02-19T21:01:32.474 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 36/177 2026-02-19T21:01:32.478 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-ceph-common-2:20.3.0-5184.ga1ac97f8.el10 37/177 2026-02-19T21:01:32.487 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-ceph-argparse-2:20.3.0-5184.ga1ac97f8.el 38/177 2026-02-19T21:01:32.488 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cephfs-2:20.3.0-5184.ga1ac97f8.el10.x86_ 39/177 2026-02-19T21:01:32.491 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 40/177 2026-02-19T21:01:32.492 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 41/177 2026-02-19T21:01:32.494 INFO:teuthology.orchestra.run.trial105.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 42/177 2026-02-19T21:01:32.496 INFO:teuthology.orchestra.run.trial105.stdout: Installing : perl-threads-shared-1.69-511.el10.x86_64 43/177 2026-02-19T21:01:32.506 INFO:teuthology.orchestra.run.trial105.stdout: Installing : perl-Thread-Queue-3.14-511.el10.noarch 44/177 2026-02-19T21:01:32.529 INFO:teuthology.orchestra.run.trial105.stdout: Installing : automake-1.16.5-20.el10.noarch 45/177 2026-02-19T21:01:32.534 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 46/177 2026-02-19T21:01:32.539 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 47/177 2026-02-19T21:01:32.543 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 48/177 2026-02-19T21:01:32.551 INFO:teuthology.orchestra.run.trial105.stdout: Installing : zip-3.0-45.el10.x86_64 49/177 2026-02-19T21:01:32.556 INFO:teuthology.orchestra.run.trial105.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 50/177 2026-02-19T21:01:32.558 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 51/177 2026-02-19T21:01:32.647 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 52/177 2026-02-19T21:01:32.648 INFO:teuthology.orchestra.run.trial105.stdout: Upgrading : librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 53/177 2026-02-19T21:01:32.672 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 53/177 2026-02-19T21:01:32.675 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 54/177 2026-02-19T21:01:32.677 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 55/177 2026-02-19T21:01:32.682 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 56/177 2026-02-19T21:01:32.684 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librados-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_ 57/177 2026-02-19T21:01:32.697 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 58/177 2026-02-19T21:01:32.705 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 59/177 2026-02-19T21:01:32.709 INFO:teuthology.orchestra.run.trial105.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 60/177 2026-02-19T21:01:32.720 INFO:teuthology.orchestra.run.trial105.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 61/177 2026-02-19T21:01:32.723 INFO:teuthology.orchestra.run.trial105.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 62/177 2026-02-19T21:01:32.724 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 63/177 2026-02-19T21:01:32.730 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 64/177 2026-02-19T21:01:32.732 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 65/177 2026-02-19T21:01:32.733 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-test-2:20.3.0-5184.ga1ac97f8.el10.x86_64 160/177 2026-02-19T21:01:32.736 INFO:teuthology.orchestra.run.trial175.stdout: Installing : elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86 161/177 2026-02-19T21:01:32.737 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 66/177 2026-02-19T21:01:32.739 INFO:teuthology.orchestra.run.trial175.stdout: Installing : xfsprogs-devel-6.11.0-2.el10.x86_64 162/177 2026-02-19T21:01:32.739 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 67/177 2026-02-19T21:01:32.749 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyperclip-1.8.2-1.el10_0.noarch 68/177 2026-02-19T21:01:32.754 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cmd2-2.5.8-1.el10_2.noarch 69/177 2026-02-19T21:01:32.757 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 70/177 2026-02-19T21:01:32.761 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 71/177 2026-02-19T21:01:32.767 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 72/177 2026-02-19T21:01:32.770 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 73/177 2026-02-19T21:01:32.770 INFO:teuthology.orchestra.run.trial175.stdout: Installing : cephfs-shell-2:20.3.0-5184.ga1ac97f8.el10.x86_64 163/177 2026-02-19T21:01:32.772 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 74/177 2026-02-19T21:01:32.774 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 75/177 2026-02-19T21:01:32.788 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 76/177 2026-02-19T21:01:32.805 INFO:teuthology.orchestra.run.trial175.stdout: Installing : postgresql-contrib-16.11-1.el10_1.x86_64 164/177 2026-02-19T21:01:32.808 INFO:teuthology.orchestra.run.trial175.stdout: Installing : ceph-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 165/177 2026-02-19T21:01:32.811 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libcephfs-devel-2:20.3.0-5184.ga1ac97f8.el10.x86 166/177 2026-02-19T21:01:32.817 INFO:teuthology.orchestra.run.trial175.stdout: Installing : rbd-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 167/177 2026-02-19T21:01:32.824 INFO:teuthology.orchestra.run.trial175.stdout: Installing : rbd-nbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 168/177 2026-02-19T21:01:32.825 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libtool-2.4.7-13.el10.x86_64 169/177 2026-02-19T21:01:32.909 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:32.912 INFO:teuthology.orchestra.run.trial175.stdout: Installing : postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:32.924 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 77/177 2026-02-19T21:01:32.928 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:32.932 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 78/177 2026-02-19T21:01:32.936 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 79/177 2026-02-19T21:01:32.938 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 80/177 2026-02-19T21:01:32.941 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 81/177 2026-02-19T21:01:32.943 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 82/177 2026-02-19T21:01:32.947 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 83/177 2026-02-19T21:01:32.950 INFO:teuthology.orchestra.run.trial105.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 84/177 2026-02-19T21:01:32.972 INFO:teuthology.orchestra.run.trial105.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 85/177 2026-02-19T21:01:32.977 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 86/177 2026-02-19T21:01:32.981 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 87/177 2026-02-19T21:01:32.987 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-ply-3.11-25.el10.noarch 88/177 2026-02-19T21:01:32.996 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 89/177 2026-02-19T21:01:33.027 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 90/177 2026-02-19T21:01:33.032 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 91/177 2026-02-19T21:01:33.041 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 92/177 2026-02-19T21:01:33.053 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 93/177 2026-02-19T21:01:33.073 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 94/177 2026-02-19T21:01:33.077 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 95/177 2026-02-19T21:01:33.079 INFO:teuthology.orchestra.run.trial105.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 96/177 2026-02-19T21:01:33.080 INFO:teuthology.orchestra.run.trial105.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 97/177 2026-02-19T21:01:33.096 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 97/177 2026-02-19T21:01:33.113 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 98/177 2026-02-19T21:01:33.115 INFO:teuthology.orchestra.run.trial105.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 98/177 2026-02-19T21:01:33.117 INFO:teuthology.orchestra.run.trial105.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 99/177 2026-02-19T21:01:33.119 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 100/177 2026-02-19T21:01:33.121 INFO:teuthology.orchestra.run.trial105.stdout: Installing : mailcap-2.1.54-8.el10.noarch 101/177 2026-02-19T21:01:33.123 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 102/177 2026-02-19T21:01:33.129 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 103/177 2026-02-19T21:01:33.131 INFO:teuthology.orchestra.run.trial105.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 104/177 2026-02-19T21:01:33.132 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 105/177 2026-02-19T21:01:33.152 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:33.152 INFO:teuthology.orchestra.run.trial105.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-19T21:01:33.152 INFO:teuthology.orchestra.run.trial105.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-19T21:01:33.152 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:33.159 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:33.162 INFO:teuthology.orchestra.run.trial175.stdout: Installing : cephfs-top-2:20.3.0-5184.ga1ac97f8.el10.noarch 171/177 2026-02-19T21:01:33.172 INFO:teuthology.orchestra.run.trial175.stdout: Installing : openssl-devel-1:3.5.1-7.el10_1.x86_64 172/177 2026-02-19T21:01:33.177 INFO:teuthology.orchestra.run.trial175.stdout: Installing : libaio-devel-0.3.111-22.el10.x86_64 173/177 2026-02-19T21:01:33.182 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 106/177 2026-02-19T21:01:33.182 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-19T21:01:33.183 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:33.192 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 107/177 2026-02-19T21:01:33.192 INFO:teuthology.orchestra.run.trial175.stdout: Installing : flex-2.6.4-19.el10.x86_64 174/177 2026-02-19T21:01:33.194 INFO:teuthology.orchestra.run.trial175.stdout: Installing : bison-3.8.2-9.el10.x86_64 175/177 2026-02-19T21:01:33.196 INFO:teuthology.orchestra.run.trial175.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 176/177 2026-02-19T21:01:33.197 INFO:teuthology.orchestra.run.trial175.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 177/177 2026-02-19T21:01:33.200 INFO:teuthology.orchestra.run.trial105.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 108/177 2026-02-19T21:01:33.203 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 109/177 2026-02-19T21:01:33.204 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x8 177/177 2026-02-19T21:01:33.205 INFO:teuthology.orchestra.run.trial105.stdout: Installing : uuid-1.6.2-65.el10.x86_64 110/177 2026-02-19T21:01:33.231 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x8 177/177 2026-02-19T21:01:33.240 INFO:teuthology.orchestra.run.trial105.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 111/177 2026-02-19T21:01:33.245 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 112/177 2026-02-19T21:01:33.248 INFO:teuthology.orchestra.run.trial105.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 113/177 2026-02-19T21:01:33.251 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 114/177 2026-02-19T21:01:33.259 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 115/177 2026-02-19T21:01:33.262 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 116/177 2026-02-19T21:01:33.276 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 117/177 2026-02-19T21:01:33.288 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-devel-3.12.12-3.el10_1.x86_64 118/177 2026-02-19T21:01:33.290 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-colorama-0.4.6-13.el10.noarch 119/177 2026-02-19T21:01:33.344 INFO:teuthology.orchestra.run.trial105.stdout: Installing : openblas-0.3.29-2.el10.x86_64 120/177 2026-02-19T21:01:33.363 INFO:teuthology.orchestra.run.trial105.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 121/177 2026-02-19T21:01:33.365 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 122/177 2026-02-19T21:01:33.366 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 123/177 2026-02-19T21:01:33.491 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 124/177 2026-02-19T21:01:33.517 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 125/177 2026-02-19T21:01:33.704 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 126/177 2026-02-19T21:01:33.711 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 127/177 2026-02-19T21:01:33.713 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libzstd-devel-1.5.5-9.el10.x86_64 128/177 2026-02-19T21:01:33.716 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libuuid-devel-2.40.2-15.el10_1.x86_64 129/177 2026-02-19T21:01:33.717 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cmake-filesystem-3.30.5-3.el10_0.x86_64 130/177 2026-02-19T21:01:33.719 INFO:teuthology.orchestra.run.trial105.stdout: Installing : zlib-ng-compat-devel-2.2.3-3.el10_1.x86_64 131/177 2026-02-19T21:01:33.725 INFO:teuthology.orchestra.run.trial105.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 132/177 2026-02-19T21:01:33.935 INFO:teuthology.orchestra.run.trial105.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 133/177 2026-02-19T21:01:33.936 INFO:teuthology.orchestra.run.trial105.stdout: Installing : librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 134/177 2026-02-19T21:01:33.953 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 134/177 2026-02-19T21:01:33.960 INFO:teuthology.orchestra.run.trial105.stdout: Installing : python3-rgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 135/177 2026-02-19T21:01:34.448 INFO:teuthology.orchestra.run.trial175.stdout: Running scriptlet: librados2-2:18.2.1-4.el10.x86_64 177/177 2026-02-19T21:01:34.448 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout:Upgraded: 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout:Installed: 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: automake-1.16.5-20.el10.noarch 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: bison-3.8.2-9.el10.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: ceph-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.449 INFO:teuthology.orchestra.run.trial175.stdout: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-grafana-dashboards-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-immutable-object-cache-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-modules-core-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.450 INFO:teuthology.orchestra.run.trial175.stdout: ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-prometheus-alerts-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-test-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: cephfs-shell-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.451 INFO:teuthology.orchestra.run.trial175.stdout: cephfs-top-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: cmake-filesystem-3.30.5-3.el10_0.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: flex-2.6.4-19.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: fuse3-3.16.2-5.el10.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-19T21:01:34.452 INFO:teuthology.orchestra.run.trial175.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libaio-devel-0.3.111-22.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs-daemon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-19T21:01:34.453 INFO:teuthology.orchestra.run.trial175.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: librados-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-19T21:01:34.454 INFO:teuthology.orchestra.run.trial175.stdout: libtool-2.4.7-13.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: libuuid-devel-2.40.2-15.el10_1.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: libzstd-devel-1.5.5-9.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: lua-5.4.6-7.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-19T21:01:34.455 INFO:teuthology.orchestra.run.trial175.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: openssl-devel-1:3.5.1-7.el10_1.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: perl-Thread-Queue-3.14-511.el10.noarch 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: perl-threads-1:2.40-511.el10.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: perl-threads-shared-1.69-511.el10.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-16.11-1.el10_1.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-contrib-16.11-1.el10_1.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-private-libs-16.11-1.el10_1.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: postgresql-server-16.11-1.el10_1.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-19T21:01:34.456 INFO:teuthology.orchestra.run.trial175.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-ceph-argparse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-cephfs-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-19T21:01:34.457 INFO:teuthology.orchestra.run.trial175.stdout: python3-cmd2-2.5.8-1.el10_2.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-colorama-0.4.6-13.el10.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-devel-3.12.12-3.el10_1.x86_64 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-19T21:01:34.458 INFO:teuthology.orchestra.run.trial175.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-ply-3.11-25.el10.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-19T21:01:34.459 INFO:teuthology.orchestra.run.trial175.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-pyperclip-1.8.2-1.el10_0.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-rados-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-rbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-rgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.460 INFO:teuthology.orchestra.run.trial175.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-19T21:01:34.461 INFO:teuthology.orchestra.run.trial175.stdout: rbd-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: rbd-nbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: unzip-6.0-69.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: uuid-1.6.2-65.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: xfsprogs-devel-6.11.0-2.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-19T21:01:34.462 INFO:teuthology.orchestra.run.trial175.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-19T21:01:34.463 INFO:teuthology.orchestra.run.trial175.stdout: zip-3.0-45.el10.x86_64 2026-02-19T21:01:34.463 INFO:teuthology.orchestra.run.trial175.stdout: zlib-ng-compat-devel-2.2.3-3.el10_1.x86_64 2026-02-19T21:01:34.463 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:01:34.463 INFO:teuthology.orchestra.run.trial175.stdout:Complete! 2026-02-19T21:01:34.536 DEBUG:teuthology.parallel:result is None 2026-02-19T21:01:34.763 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:34.765 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:34.961 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 136/177 2026-02-19T21:01:34.964 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 137/177 2026-02-19T21:01:34.994 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 137/177 2026-02-19T21:01:34.995 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-19T21:01:34.995 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-19T21:01:34.995 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:34.997 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 138/177 2026-02-19T21:01:39.100 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 138/177 2026-02-19T21:01:39.100 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /sys 2026-02-19T21:01:39.100 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /proc 2026-02-19T21:01:39.101 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /mnt 2026-02-19T21:01:39.101 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /var/tmp 2026-02-19T21:01:39.101 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /home 2026-02-19T21:01:39.101 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /root 2026-02-19T21:01:39.101 INFO:teuthology.orchestra.run.trial105.stdout:skipping the directory /tmp 2026-02-19T21:01:39.101 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:40.178 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x8 139/177 2026-02-19T21:01:40.208 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x8 140/177 2026-02-19T21:01:40.209 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 141/177 2026-02-19T21:01:40.225 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 141/177 2026-02-19T21:01:40.225 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:40.225 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-19T21:01:40.225 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:40.232 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 142/177 2026-02-19T21:01:40.254 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 142/177 2026-02-19T21:01:40.254 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:40.255 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-19T21:01:40.255 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-19T21:01:40.255 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-19T21:01:40.255 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:40.327 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 143/177 2026-02-19T21:01:40.347 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 143/177 2026-02-19T21:01:40.347 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:40.348 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-19T21:01:40.348 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-19T21:01:40.348 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-19T21:01:40.348 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:40.537 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 144/177 2026-02-19T21:01:40.559 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 144/177 2026-02-19T21:01:40.559 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:40.559 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-19T21:01:40.559 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-19T21:01:40.559 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-19T21:01:40.559 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:40.593 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 145/177 2026-02-19T21:01:40.595 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 145/177 2026-02-19T21:01:40.602 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5184.ga1ac97f8.e 146/177 2026-02-19T21:01:40.614 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5184.ga1ac97f8. 147/177 2026-02-19T21:01:40.615 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.no 148/177 2026-02-19T21:01:41.519 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.no 148/177 2026-02-19T21:01:41.524 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10. 149/177 2026-02-19T21:01:41.876 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10. 149/177 2026-02-19T21:01:41.877 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1a 150/177 2026-02-19T21:01:41.887 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1a 150/177 2026-02-19T21:01:41.887 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10. 151/177 2026-02-19T21:01:41.919 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10. 151/177 2026-02-19T21:01:41.951 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5184.ga1ac97f8.el 152/177 2026-02-19T21:01:41.952 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 153/177 2026-02-19T21:01:41.974 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 153/177 2026-02-19T21:01:41.974 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:41.974 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-19T21:01:41.974 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-19T21:01:41.975 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-19T21:01:41.975 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:41.980 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarc 154/177 2026-02-19T21:01:41.991 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarc 154/177 2026-02-19T21:01:42.420 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-2:20.3.0-5184.ga1ac97f8.el10.x86_64 155/177 2026-02-19T21:01:42.422 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 156/177 2026-02-19T21:01:42.445 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 156/177 2026-02-19T21:01:42.445 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:42.445 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-19T21:01:42.445 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-19T21:01:42.445 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-19T21:01:42.445 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:42.451 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5184.ga1ac9 157/177 2026-02-19T21:01:42.471 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5184.ga1ac9 157/177 2026-02-19T21:01:42.471 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:42.471 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-19T21:01:42.471 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:42.480 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_6 158/177 2026-02-19T21:01:42.501 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_6 158/177 2026-02-19T21:01:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-19T21:01:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-19T21:01:42.501 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-19T21:01:42.502 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:42.595 INFO:teuthology.orchestra.run.trial105.stdout: Installing : rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 159/177 2026-02-19T21:01:42.615 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 159/177 2026-02-19T21:01:42.615 INFO:teuthology.orchestra.run.trial105.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-19T21:01:42.615 INFO:teuthology.orchestra.run.trial105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-19T21:01:42.615 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-19T21:01:42.615 INFO:teuthology.orchestra.run.trial105.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-19T21:01:42.616 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:45.210 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-test-2:20.3.0-5184.ga1ac97f8.el10.x86_64 160/177 2026-02-19T21:01:45.213 INFO:teuthology.orchestra.run.trial105.stdout: Installing : elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86 161/177 2026-02-19T21:01:45.215 INFO:teuthology.orchestra.run.trial105.stdout: Installing : xfsprogs-devel-6.11.0-2.el10.x86_64 162/177 2026-02-19T21:01:45.246 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cephfs-shell-2:20.3.0-5184.ga1ac97f8.el10.x86_64 163/177 2026-02-19T21:01:45.281 INFO:teuthology.orchestra.run.trial105.stdout: Installing : postgresql-contrib-16.11-1.el10_1.x86_64 164/177 2026-02-19T21:01:45.284 INFO:teuthology.orchestra.run.trial105.stdout: Installing : ceph-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 165/177 2026-02-19T21:01:45.287 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libcephfs-devel-2:20.3.0-5184.ga1ac97f8.el10.x86 166/177 2026-02-19T21:01:45.293 INFO:teuthology.orchestra.run.trial105.stdout: Installing : rbd-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 167/177 2026-02-19T21:01:45.299 INFO:teuthology.orchestra.run.trial105.stdout: Installing : rbd-nbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 168/177 2026-02-19T21:01:45.301 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libtool-2.4.7-13.el10.x86_64 169/177 2026-02-19T21:01:45.383 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:45.386 INFO:teuthology.orchestra.run.trial105.stdout: Installing : postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:45.401 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 170/177 2026-02-19T21:01:45.632 INFO:teuthology.orchestra.run.trial105.stdout: Installing : cephfs-top-2:20.3.0-5184.ga1ac97f8.el10.noarch 171/177 2026-02-19T21:01:45.641 INFO:teuthology.orchestra.run.trial105.stdout: Installing : openssl-devel-1:3.5.1-7.el10_1.x86_64 172/177 2026-02-19T21:01:45.647 INFO:teuthology.orchestra.run.trial105.stdout: Installing : libaio-devel-0.3.111-22.el10.x86_64 173/177 2026-02-19T21:01:45.661 INFO:teuthology.orchestra.run.trial105.stdout: Installing : flex-2.6.4-19.el10.x86_64 174/177 2026-02-19T21:01:45.664 INFO:teuthology.orchestra.run.trial105.stdout: Installing : bison-3.8.2-9.el10.x86_64 175/177 2026-02-19T21:01:45.665 INFO:teuthology.orchestra.run.trial105.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 176/177 2026-02-19T21:01:45.666 INFO:teuthology.orchestra.run.trial105.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 177/177 2026-02-19T21:01:45.673 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x8 177/177 2026-02-19T21:01:45.699 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x8 177/177 2026-02-19T21:01:46.899 INFO:teuthology.orchestra.run.trial105.stdout: Running scriptlet: librados2-2:18.2.1-4.el10.x86_64 177/177 2026-02-19T21:01:46.899 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:46.899 INFO:teuthology.orchestra.run.trial105.stdout:Upgraded: 2026-02-19T21:01:46.899 INFO:teuthology.orchestra.run.trial105.stdout: librados2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.899 INFO:teuthology.orchestra.run.trial105.stdout: librbd1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.899 INFO:teuthology.orchestra.run.trial105.stdout:Installed: 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: automake-1.16.5-20.el10.noarch 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: bison-3.8.2-9.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-base-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-grafana-dashboards-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-immutable-object-cache-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.900 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mds-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-dashboard-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-k8sevents-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-modules-core-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mgr-rook-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-mon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-classic-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-osd-crimson-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.901 INFO:teuthology.orchestra.run.trial105.stdout: ceph-prometheus-alerts-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: ceph-radosgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: ceph-selinux-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: ceph-test-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: ceph-volume-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: cephadm-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: cephfs-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: cephfs-shell-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: cephfs-top-2:20.3.0-5184.ga1ac97f8.el10.noarch 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: cmake-filesystem-3.30.5-3.el10_0.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-19T21:01:46.902 INFO:teuthology.orchestra.run.trial105.stdout: elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: flex-2.6.4-19.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: fuse3-3.16.2-5.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-19T21:01:46.903 INFO:teuthology.orchestra.run.trial105.stdout: libaio-devel-0.3.111-22.el10.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-daemon-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs-proxy2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libcephfs2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libcephsqlite-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.904 INFO:teuthology.orchestra.run.trial105.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-19T21:01:46.905 INFO:teuthology.orchestra.run.trial105.stdout: librados-devel-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libradosstriper1-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: librgw2-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libtool-2.4.7-13.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libuuid-devel-2.40.2-15.el10_1.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: libzstd-devel-1.5.5-9.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-19T21:01:46.906 INFO:teuthology.orchestra.run.trial105.stdout: lua-5.4.6-7.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: openssl-devel-1:3.5.1-7.el10_1.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: perl-Thread-Queue-3.14-511.el10.noarch 2026-02-19T21:01:46.907 INFO:teuthology.orchestra.run.trial105.stdout: perl-threads-1:2.40-511.el10.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: perl-threads-shared-1.69-511.el10.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-16.11-1.el10_1.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-contrib-16.11-1.el10_1.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-private-libs-16.11-1.el10_1.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: postgresql-server-16.11-1.el10_1.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-19T21:01:46.908 INFO:teuthology.orchestra.run.trial105.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-argparse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-ceph-common-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-cephfs-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-cmd2-2.5.8-1.el10_2.noarch 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-colorama-0.4.6-13.el10.noarch 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-devel-3.12.12-3.el10_1.x86_64 2026-02-19T21:01:46.909 INFO:teuthology.orchestra.run.trial105.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-19T21:01:46.910 INFO:teuthology.orchestra.run.trial105.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-19T21:01:46.911 INFO:teuthology.orchestra.run.trial105.stdout: python3-ply-3.11-25.el10.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-pyperclip-1.8.2-1.el10_0.noarch 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-rados-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.912 INFO:teuthology.orchestra.run.trial105.stdout: python3-rbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-rgw-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-19T21:01:46.913 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: rbd-fuse-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: rbd-mirror-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: rbd-nbd-2:20.3.0-5184.ga1ac97f8.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-19T21:01:46.914 INFO:teuthology.orchestra.run.trial105.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: unzip-6.0-69.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: uuid-1.6.2-65.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: xfsprogs-devel-6.11.0-2.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: zip-3.0-45.el10.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: zlib-ng-compat-devel-2.2.3-3.el10_1.x86_64 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:01:46.915 INFO:teuthology.orchestra.run.trial105.stdout:Complete! 2026-02-19T21:01:46.983 DEBUG:teuthology.parallel:result is None 2026-02-19T21:01:46.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:47.151 DEBUG:teuthology.orchestra.run.trial090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-19T21:01:47.175 INFO:teuthology.orchestra.run.trial090.stdout:20.3.0-5184.ga1ac97f8.el10 2026-02-19T21:01:47.176 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5184.ga1ac97f8.el10 2026-02-19T21:01:47.176 INFO:teuthology.task.install:The correct ceph version 20.3.0-5184.ga1ac97f8 is installed. 2026-02-19T21:01:47.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:47.340 DEBUG:teuthology.orchestra.run.trial105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-19T21:01:47.365 INFO:teuthology.orchestra.run.trial105.stdout:20.3.0-5184.ga1ac97f8.el10 2026-02-19T21:01:47.365 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5184.ga1ac97f8.el10 2026-02-19T21:01:47.365 INFO:teuthology.task.install:The correct ceph version 20.3.0-5184.ga1ac97f8 is installed. 2026-02-19T21:01:47.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:47.520 DEBUG:teuthology.orchestra.run.trial175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-19T21:01:47.544 INFO:teuthology.orchestra.run.trial175.stdout:20.3.0-5184.ga1ac97f8.el10 2026-02-19T21:01:47.545 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5184.ga1ac97f8.el10 2026-02-19T21:01:47.545 INFO:teuthology.task.install:The correct ceph version 20.3.0-5184.ga1ac97f8 is installed. 2026-02-19T21:01:47.547 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-19T21:01:47.547 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:01:47.547 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T21:01:47.578 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:01:47.578 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T21:01:47.607 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:01:47.607 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-19T21:01:47.636 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-19T21:01:47.637 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:01:47.637 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T21:01:47.664 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T21:01:47.731 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:01:47.731 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T21:01:47.757 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T21:01:47.824 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:01:47.825 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/usr/bin/daemon-helper 2026-02-19T21:01:47.853 DEBUG:teuthology.orchestra.run.trial175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-19T21:01:47.919 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-19T21:01:47.919 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:01:47.919 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T21:01:47.946 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T21:01:48.013 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:01:48.013 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T21:01:48.039 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T21:01:48.107 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:01:48.108 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-19T21:01:48.136 DEBUG:teuthology.orchestra.run.trial175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-19T21:01:48.202 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-19T21:01:48.202 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:01:48.202 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T21:01:48.231 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T21:01:48.297 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:01:48.297 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T21:01:48.325 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T21:01:48.392 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:01:48.392 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/usr/bin/stdin-killer 2026-02-19T21:01:48.421 DEBUG:teuthology.orchestra.run.trial175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-19T21:01:48.487 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-19T21:01:48.616 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds use global snaprealm seq for subvol': False, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2026-02-19T21:01:48.616 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 2026-02-19T21:01:48.618 INFO:tasks.cephadm:Cluster fsid is 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:01:48.618 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-19T21:01:48.618 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.90', 'mon.b': '10.20.193.105', 'mon.c': '10.20.193.175'} 2026-02-19T21:01:48.618 INFO:tasks.cephadm:First mon is mon.a on trial090 2026-02-19T21:01:48.618 INFO:tasks.cephadm:First mgr is x 2026-02-19T21:01:48.618 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-19T21:01:48.618 DEBUG:teuthology.orchestra.run.trial090:> sudo hostname $(hostname -s) 2026-02-19T21:01:48.646 DEBUG:teuthology.orchestra.run.trial105:> sudo hostname $(hostname -s) 2026-02-19T21:01:48.673 DEBUG:teuthology.orchestra.run.trial175:> sudo hostname $(hostname -s) 2026-02-19T21:01:48.700 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-19T21:01:48.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:48.845 INFO:tasks.cephadm:builder_project result: [{'url': 'https://2.chacra.ceph.com/r/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/flavors/default/', 'ref': 'wip-rocky10-branch-of-the-day-2026-02-06-1770413686', 'sha1': 'a1ac97f8290bb2544f44f608df68f43689827c55', 'distro': 'rocky', 'distro_version': '10', 'distro_codename': None, 'modified': '2026-02-07 02:27:51.899347', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5184-ga1ac97f8', 'package_manager_version': '20.3.0-5184.ga1ac97f8', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2849/', 'root_build_cause': '', 'node_name': '10.20.192.98+toko08', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-19T21:01:48.985 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-rocky10-branch-of-the-day-2026-02-06-1770413686, sha1 a1ac97f8290bb2544f44f608df68f43689827c55 from https://shaman.ceph.com/api/search/?project=ceph&distros=rocky%2F10%2Fx86_64&flavor=default&sha1=a1ac97f8290bb2544f44f608df68f43689827c55 2026-02-19T21:01:48.986 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/x86_64/flavors/default/cephadm 2026-02-19T21:01:48.986 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/x86_64/flavors/default/cephadm 2026-02-19T21:01:48.986 DEBUG:teuthology.orchestra.run.trial090:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.324 INFO:teuthology.orchestra.run.trial090.stdout:-rw-r--r--. 1 ubuntu ubuntu 1406107 Feb 19 21:01 /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.325 DEBUG:teuthology.orchestra.run.trial105:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.630 INFO:teuthology.orchestra.run.trial105.stdout:-rw-r--r--. 1 ubuntu ubuntu 1406107 Feb 19 21:01 /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.630 DEBUG:teuthology.orchestra.run.trial175:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-rocky10-branch-of-the-day-2026-02-06-1770413686/a1ac97f8290bb2544f44f608df68f43689827c55/rocky/10/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.928 INFO:teuthology.orchestra.run.trial175.stdout:-rw-r--r--. 1 ubuntu ubuntu 1406107 Feb 19 21:01 /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.929 DEBUG:teuthology.orchestra.run.trial090:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.949 DEBUG:teuthology.orchestra.run.trial105:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:49.970 DEBUG:teuthology.orchestra.run.trial175:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-19T21:01:50.013 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 on all hosts... 2026-02-19T21:01:50.013 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 pull 2026-02-19T21:01:50.016 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 pull 2026-02-19T21:01:50.018 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 pull 2026-02-19T21:01:50.251 INFO:teuthology.orchestra.run.trial105.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10... 2026-02-19T21:01:50.252 INFO:teuthology.orchestra.run.trial090.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10... 2026-02-19T21:01:50.268 INFO:teuthology.orchestra.run.trial175.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10... 2026-02-19T21:02:01.218 INFO:teuthology.orchestra.run.trial175.stdout:{ 2026-02-19T21:02:01.218 INFO:teuthology.orchestra.run.trial175.stdout: "ceph_version": "ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev)", 2026-02-19T21:02:01.218 INFO:teuthology.orchestra.run.trial175.stdout: "image_id": "355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485", 2026-02-19T21:02:01.218 INFO:teuthology.orchestra.run.trial175.stdout: "repo_digests": [ 2026-02-19T21:02:01.218 INFO:teuthology.orchestra.run.trial175.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21" 2026-02-19T21:02:01.219 INFO:teuthology.orchestra.run.trial175.stdout: ] 2026-02-19T21:02:01.219 INFO:teuthology.orchestra.run.trial175.stdout:} 2026-02-19T21:02:01.282 INFO:teuthology.orchestra.run.trial090.stdout:{ 2026-02-19T21:02:01.283 INFO:teuthology.orchestra.run.trial090.stdout: "ceph_version": "ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev)", 2026-02-19T21:02:01.283 INFO:teuthology.orchestra.run.trial090.stdout: "image_id": "355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485", 2026-02-19T21:02:01.283 INFO:teuthology.orchestra.run.trial090.stdout: "repo_digests": [ 2026-02-19T21:02:01.283 INFO:teuthology.orchestra.run.trial090.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21" 2026-02-19T21:02:01.283 INFO:teuthology.orchestra.run.trial090.stdout: ] 2026-02-19T21:02:01.283 INFO:teuthology.orchestra.run.trial090.stdout:} 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout:{ 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout: "ceph_version": "ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev)", 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout: "image_id": "355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485", 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout: "repo_digests": [ 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21" 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout: ] 2026-02-19T21:02:01.284 INFO:teuthology.orchestra.run.trial105.stdout:} 2026-02-19T21:02:01.298 DEBUG:teuthology.orchestra.run.trial090:> sudo mkdir -p /etc/ceph 2026-02-19T21:02:01.359 DEBUG:teuthology.orchestra.run.trial105:> sudo mkdir -p /etc/ceph 2026-02-19T21:02:01.389 DEBUG:teuthology.orchestra.run.trial175:> sudo mkdir -p /etc/ceph 2026-02-19T21:02:01.420 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 777 /etc/ceph 2026-02-19T21:02:01.448 DEBUG:teuthology.orchestra.run.trial105:> sudo chmod 777 /etc/ceph 2026-02-19T21:02:01.474 DEBUG:teuthology.orchestra.run.trial175:> sudo chmod 777 /etc/ceph 2026-02-19T21:02:01.501 INFO:tasks.cephadm:Writing seed config... 2026-02-19T21:02:01.503 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-19T21:02:01.503 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-19T21:02:01.503 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-19T21:02:01.504 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-19T21:02:01.505 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2026-02-19T21:02:01.506 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:01.507 DEBUG:teuthology.orchestra.run.trial090:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-19T21:02:01.524 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 34db945f-0dd6-11f1-890f-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.2 2026-02-19T21:02:01.525 DEBUG:teuthology.orchestra.run.trial090:mon.a> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service 2026-02-19T21:02:01.567 DEBUG:teuthology.orchestra.run.trial090:mgr.x> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service 2026-02-19T21:02:01.609 INFO:tasks.cephadm:Bootstrapping... 2026-02-19T21:02:01.610 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 -v bootstrap --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.90 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:01.755 INFO:teuthology.orchestra.run.trial090.stdout:-------------------------------------------------------------------------------- 2026-02-19T21:02:01.755 INFO:teuthology.orchestra.run.trial090.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', '-v', 'bootstrap', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.90', '--skip-dashboard', '--skip-admin-label'] 2026-02-19T21:02:01.756 INFO:teuthology.orchestra.run.trial090.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-19T21:02:01.756 INFO:teuthology.orchestra.run.trial090.stdout:Verifying podman|docker is present... 2026-02-19T21:02:01.771 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stdout 5.6.0 2026-02-19T21:02:01.771 INFO:teuthology.orchestra.run.trial090.stdout:Verifying lvm2 is present... 2026-02-19T21:02:01.771 INFO:teuthology.orchestra.run.trial090.stdout:Verifying time synchronization is in place... 2026-02-19T21:02:01.776 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 4 from systemctl is-enabled chrony.service 2026-02-19T21:02:01.776 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout not-found 2026-02-19T21:02:01.779 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 4 from systemctl is-active chrony.service 2026-02-19T21:02:01.779 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-19T21:02:01.783 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout enabled 2026-02-19T21:02:01.788 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout active 2026-02-19T21:02:01.788 INFO:teuthology.orchestra.run.trial090.stdout:Unit chronyd.service is enabled and running 2026-02-19T21:02:01.788 INFO:teuthology.orchestra.run.trial090.stdout:Repeating the final host check... 2026-02-19T21:02:01.802 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stdout 5.6.0 2026-02-19T21:02:01.802 INFO:teuthology.orchestra.run.trial090.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-19T21:02:01.802 INFO:teuthology.orchestra.run.trial090.stdout:systemctl is present 2026-02-19T21:02:01.802 INFO:teuthology.orchestra.run.trial090.stdout:lvcreate is present 2026-02-19T21:02:01.805 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 4 from systemctl is-enabled chrony.service 2026-02-19T21:02:01.806 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout not-found 2026-02-19T21:02:01.809 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 4 from systemctl is-active chrony.service 2026-02-19T21:02:01.809 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-19T21:02:01.814 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout enabled 2026-02-19T21:02:01.818 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout active 2026-02-19T21:02:01.818 INFO:teuthology.orchestra.run.trial090.stdout:Unit chronyd.service is enabled and running 2026-02-19T21:02:01.819 INFO:teuthology.orchestra.run.trial090.stdout:Host looks OK 2026-02-19T21:02:01.819 INFO:teuthology.orchestra.run.trial090.stdout:Cluster fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:01.819 INFO:teuthology.orchestra.run.trial090.stdout:Acquiring lock 139623671639760 on /run/cephadm/34db945f-0dd6-11f1-890f-d404e6e7d460.lock 2026-02-19T21:02:01.819 INFO:teuthology.orchestra.run.trial090.stdout:Lock 139623671639760 acquired on /run/cephadm/34db945f-0dd6-11f1-890f-d404e6e7d460.lock 2026-02-19T21:02:01.819 INFO:teuthology.orchestra.run.trial090.stdout:Verifying IP 10.20.193.90 port 3300 ... 2026-02-19T21:02:01.819 INFO:teuthology.orchestra.run.trial090.stdout:Verifying IP 10.20.193.90 port 6789 ... 2026-02-19T21:02:01.820 INFO:teuthology.orchestra.run.trial090.stdout:Base mon IP(s) is [10.20.193.90:3300, 10.20.193.90:6789], mon addrv is [v2:10.20.193.90:3300,v1:10.20.193.90:6789] 2026-02-19T21:02:01.821 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.90 metric 102 2026-02-19T21:02:01.821 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.90 metric 102 2026-02-19T21:02:01.821 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-19T21:02:01.822 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-19T21:02:01.822 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout inet6 ::1/128 scope host noprefixroute 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout inet6 fe80::bc3a:f2ff:feb6:59f/64 scope link noprefixroute 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout 3: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:62c4/64 scope link proto kernel_ll 2026-02-19T21:02:01.824 INFO:teuthology.orchestra.run.trial090.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-19T21:02:01.825 INFO:teuthology.orchestra.run.trial090.stdout:Mon IP `10.20.193.90` is in CIDR network `10.20.192.0/20` 2026-02-19T21:02:01.825 INFO:teuthology.orchestra.run.trial090.stdout:Mon IP `10.20.193.90` is in CIDR network `10.20.192.0/20` 2026-02-19T21:02:01.825 INFO:teuthology.orchestra.run.trial090.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-19T21:02:01.825 INFO:teuthology.orchestra.run.trial090.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-19T21:02:01.825 INFO:teuthology.orchestra.run.trial090.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10... 2026-02-19T21:02:02.136 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stdout 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 2026-02-19T21:02:02.136 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10... 2026-02-19T21:02:02.137 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Getting image source signatures 2026-02-19T21:02:02.137 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-19T21:02:02.137 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Copying blob sha256:8e1a921d2b7f0b69f1de43614a0818e2dc349b92ff578be722e7185f93d2303e 2026-02-19T21:02:02.137 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Copying config sha256:355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 2026-02-19T21:02:02.137 INFO:teuthology.orchestra.run.trial090.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-19T21:02:02.263 INFO:teuthology.orchestra.run.trial090.stdout:ceph: stdout ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev) 2026-02-19T21:02:02.264 INFO:teuthology.orchestra.run.trial090.stdout:Ceph version: ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev) 2026-02-19T21:02:02.264 INFO:teuthology.orchestra.run.trial090.stdout:Extracting ceph user uid/gid from container image... 2026-02-19T21:02:02.385 INFO:teuthology.orchestra.run.trial090.stdout:stat: stdout 167 167 2026-02-19T21:02:02.385 INFO:teuthology.orchestra.run.trial090.stdout:Creating initial keys... 2026-02-19T21:02:02.473 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph-authtool: stdout AQBKepdpw9meGxAAccfMvj98J3nrHradhsnN+Q== 2026-02-19T21:02:02.570 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph-authtool: stdout AQBKepdp8jlfIRAAS7bRJuUdY4UNj9WkVTf64w== 2026-02-19T21:02:02.708 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph-authtool: stdout AQBKepdpFbmiKRAA9Wy/YZ3qnKDtKdwyAZu+Hg== 2026-02-19T21:02:02.709 INFO:teuthology.orchestra.run.trial090.stdout:Creating initial monmap... 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:monmaptool for a [v2:10.20.193.90:3300,v1:10.20.193.90:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:setting min_mon_release = tentacle 2026-02-19T21:02:02.776 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: set fsid to 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:02.777 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-19T21:02:02.777 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:02.777 INFO:teuthology.orchestra.run.trial090.stdout:Creating mon... 2026-02-19T21:02:02.928 INFO:teuthology.orchestra.run.trial090.stdout:create mon.a on 2026-02-19T21:02:03.123 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Removed '/etc/systemd/system/multi-user.target.wants/ceph.target'. 2026-02-19T21:02:03.258 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/etc/systemd/system/ceph.target'. 2026-02-19T21:02:03.387 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460.target' → '/etc/systemd/system/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460.target'. 2026-02-19T21:02:03.387 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink '/etc/systemd/system/ceph.target.wants/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460.target' → '/etc/systemd/system/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460.target'. 2026-02-19T21:02:03.553 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a 2026-02-19T21:02:03.553 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Failed to reset failed state of unit ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service: Unit ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service not loaded. 2026-02-19T21:02:03.711 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink '/etc/systemd/system/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460.target.wants/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service' → '/etc/systemd/system/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@.service'. 2026-02-19T21:02:03.786 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:02:03.858 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T21:02:03.858 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-19T21:02:03.864 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T21:02:03.864 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-19T21:02:03.864 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-19T21:02:03.864 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to enable service . firewalld.service is not available 2026-02-19T21:02:03.864 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mon to start... 2026-02-19T21:02:03.864 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mon... 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout cluster: 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout id: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout services: 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.146575s) [leader: a] 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-19T21:02:04.039 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout data: 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout pgs: 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:mon is available 2026-02-19T21:02:04.040 INFO:teuthology.orchestra.run.trial090.stdout:Assimilating anything we can from ceph.conf... 2026-02-19T21:02:04.042 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 podman[31311]: 2026-02-19 21:02:03.818468293 +0000 UTC m=+0.015938414 container create 12e02f877af09f436b06731d4118d6e1bd5c6ddae0be35ba8f8ce56c7b4fc05f (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, org.opencontainers.image.title=rockylinux, version=10, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, license=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:02:04.042 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 podman[31311]: 2026-02-19 21:02:03.845182626 +0000 UTC m=+0.042652757 container init 12e02f877af09f436b06731d4118d6e1bd5c6ddae0be35ba8f8ce56c7b4fc05f (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-19T21:02:04.042 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 podman[31311]: 2026-02-19 21:02:03.847074737 +0000 UTC m=+0.044544858 container start 12e02f877af09f436b06731d4118d6e1bd5c6ddae0be35ba8f8ce56c7b4fc05f (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, name=rockylinux, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:02:04.042 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 bash[31311]: 12e02f877af09f436b06731d4118d6e1bd5c6ddae0be35ba8f8ce56c7b4fc05f 2026-02-19T21:02:04.043 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 podman[31311]: 2026-02-19 21:02:03.811818908 +0000 UTC m=+0.009289039 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 2026-02-19T21:02:04.043 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:02:04.043 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 ceph-mon[31340]: mkfs 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:04.043 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:03 trial090 ceph-mon[31340]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T21:02:04.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:04.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [global] 2026-02-19T21:02:04.204 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout fsid = 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.90:3300,v1:10.20.193.90:6789] 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:04.205 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [osd] 2026-02-19T21:02:04.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-19T21:02:04.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-19T21:02:04.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-19T21:02:04.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-19T21:02:04.206 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-19T21:02:04.206 INFO:teuthology.orchestra.run.trial090.stdout:Generating new minimal ceph.conf... 2026-02-19T21:02:04.356 INFO:teuthology.orchestra.run.trial090.stdout:Restarting the monitor... 2026-02-19T21:02:04.644 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:02:04.644 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a[31336]: 2026-02-19T21:02:04.436+0000 7fc4b23026c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:02:04.644 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a[31336]: 2026-02-19T21:02:04.436+0000 7fc4b23026c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-19T21:02:04.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 podman[31610]: 2026-02-19 21:02:04.487434632 +0000 UTC m=+0.060898349 container died 12e02f877af09f436b06731d4118d6e1bd5c6ddae0be35ba8f8ce56c7b4fc05f (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, io.buildah.version=1.41.3, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:02:04.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 podman[31610]: 2026-02-19 21:02:04.494146111 +0000 UTC m=+0.067609828 container remove 12e02f877af09f436b06731d4118d6e1bd5c6ddae0be35ba8f8ce56c7b4fc05f (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, name=rockylinux, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:02:04.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 bash[31610]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a 2026-02-19T21:02:04.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 systemd[1]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-19T21:02:04.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 systemd[1]: Stopped ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:02:04.645 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:02:04.676 INFO:teuthology.orchestra.run.trial090.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-19T21:02:04.841 INFO:teuthology.orchestra.run.trial090.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-19T21:02:04.841 INFO:teuthology.orchestra.run.trial090.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:04.842 INFO:teuthology.orchestra.run.trial090.stdout:Creating mgr... 2026-02-19T21:02:04.842 INFO:teuthology.orchestra.run.trial090.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-19T21:02:04.842 INFO:teuthology.orchestra.run.trial090.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-19T21:02:04.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 podman[31728]: 2026-02-19 21:02:04.644116742 +0000 UTC m=+0.015062272 container create 12c2c903cce4c57a992e7bdec693fbe1a1b1091ab39deee0a759f491272a8685 (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.title=rockylinux, ceph=True, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 podman[31728]: 2026-02-19 21:02:04.669477711 +0000 UTC m=+0.040423231 container init 12c2c903cce4c57a992e7bdec693fbe1a1b1091ab39deee0a759f491272a8685 (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.title=rockylinux) 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 podman[31728]: 2026-02-19 21:02:04.671174441 +0000 UTC m=+0.042119971 container start 12c2c903cce4c57a992e7bdec693fbe1a1b1091ab39deee0a759f491272a8685 (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, io.buildah.version=1.41.3, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 bash[31728]: 12c2c903cce4c57a992e7bdec693fbe1a1b1091ab39deee0a759f491272a8685 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 podman[31728]: 2026-02-19 21:02:04.63822496 +0000 UTC m=+0.009170490 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: set uid:gid to 167:167 (ceph:ceph) 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: pidfile_write: ignore empty --pid-file 2026-02-19T21:02:04.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: load: jerasure load: lrc 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: RocksDB version: 7.9.2 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Git sha 0 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Compile date 2026-02-07 00:48:56 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: DB SUMMARY 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: DB Session ID: MHZGOMQJ34Y4A2TEWPTV 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: CURRENT file: CURRENT 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: IDENTITY file: IDENTITY 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 84159 ; 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.error_if_exists: 0 2026-02-19T21:02:04.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.create_if_missing: 0 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.paranoid_checks: 1 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.env: 0x55bea14b5280 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.fs: PosixFileSystem 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.info_log: 0x55beb644ae00 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_file_opening_threads: 16 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.statistics: (nil) 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.use_fsync: 0 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_log_file_size: 0 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-19T21:02:04.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.keep_log_file_num: 1000 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.recycle_log_file_num: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.allow_fallocate: 1 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.allow_mmap_reads: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.allow_mmap_writes: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.use_direct_reads: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.create_missing_column_families: 0 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.db_log_dir: 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.wal_dir: 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-19T21:02:04.911 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.advise_random_on_open: 1 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.db_write_buffer_size: 0 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.write_buffer_manager: 0x55beb6441c20 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.rate_limiter: (nil) 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-19T21:02:04.912 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.wal_recovery_mode: 2 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.enable_thread_tracking: 0 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.enable_pipelined_write: 0 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.unordered_write: 0 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.row_cache: None 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.wal_filter: None 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.allow_ingest_behind: 0 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.two_write_queues: 0 2026-02-19T21:02:04.913 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.manual_wal_flush: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.wal_compression: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.atomic_flush: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.log_readahead_size: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.best_efforts_recovery: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.allow_data_in_errors: 0 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.db_host_id: __hostname__ 2026-02-19T21:02:04.914 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_background_jobs: 2 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_background_compactions: -1 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_subcompactions: 1 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_total_wal_size: 0 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_open_files: -1 2026-02-19T21:02:04.915 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bytes_per_sync: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_readahead_size: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_background_flushes: -1 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Compression algorithms supported: 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kZSTD supported: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kXpressCompression supported: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kBZip2Compression supported: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kLZ4Compression supported: 1 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kZlibCompression supported: 1 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kLZ4HCCompression supported: 1 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: kSnappyCompression supported: 1 2026-02-19T21:02:04.916 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.merge_operator: 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_filter: None 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_filter_factory: None 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.sst_partitioner_factory: None 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55beb644b8c0) 2026-02-19T21:02:04.917 INFO:journalctl@ceph.mon.a.trial090.stdout: cache_index_and_filter_blocks: 1 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: pin_top_level_index_and_filter: 1 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: index_type: 0 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: data_block_index_type: 0 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: index_shortening: 1 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: checksum: 4 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: no_block_cache: 0 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache: 0x55beb64a6010 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache_name: BinnedLRUCache 2026-02-19T21:02:04.918 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache_options: 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: capacity : 536870912 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: num_shard_bits : 4 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: strict_capacity_limit : 0 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: high_pri_pool_ratio: 0.000 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: block_cache_compressed: (nil) 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: persistent_cache: (nil) 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: block_size: 4096 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: block_size_deviation: 10 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: block_restart_interval: 16 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: index_block_restart_interval: 1 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: metadata_block_size: 4096 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: partition_filters: 0 2026-02-19T21:02:04.919 INFO:journalctl@ceph.mon.a.trial090.stdout: use_delta_encoding: 1 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: filter_policy: bloomfilter 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: whole_key_filtering: 1 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: verify_compression: 0 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: read_amp_bytes_per_bit: 0 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: format_version: 5 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: enable_index_compression: 1 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: block_align: 0 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: max_auto_readahead_size: 262144 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: prepopulate_block_cache: 0 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: initial_auto_readahead_size: 8192 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout: num_file_reads_for_auto_readahead: 2 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.write_buffer_size: 33554432 2026-02-19T21:02:04.920 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_write_buffer_number: 2 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression: NoCompression 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression: Disabled 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.prefix_extractor: nullptr 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.num_levels: 7 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-19T21:02:04.921 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.level: 32767 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.strategy: 0 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.enabled: false 2026-02-19T21:02:04.922 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.target_file_size_base: 67108864 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-19T21:02:04.923 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.arena_block_size: 1048576 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.disable_auto_compactions: 0 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-19T21:02:04.924 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.inplace_update_support: 0 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-19T21:02:04.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.bloom_locality: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.max_successive_merges: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.paranoid_file_checks: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.force_consistency_checks: 1 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.report_bg_io_stats: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.ttl: 2592000 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.enable_blob_files: false 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.min_blob_size: 0 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.blob_file_size: 268435456 2026-02-19T21:02:04.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.blob_file_starting_level: 0 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2d5ede2c-76d9-40ef-8ef9-c9f390edb86e 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534924686267, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-19T21:02:04.927 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534924686927, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 80582, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 259, "table_properties": {"data_size": 78757, "index_size": 210, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11606, "raw_average_key_size": 50, "raw_value_size": 72267, "raw_average_value_size": 314, "num_data_blocks": 9, "num_entries": 230, "num_filter_entries": 230, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771534924, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2d5ede2c-76d9-40ef-8ef9-c9f390edb86e", "db_session_id": "MHZGOMQJ34Y4A2TEWPTV", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534924686985, "job": 1, "event": "recovery_finished"} 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55beb6466e00 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: DB pointer 0x55beb7270000 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout: ** DB Stats ** 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T21:02:04.928 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: ** Compaction Stats [default] ** 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: L0 2/0 80.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: Sum 2/0 80.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 157.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-19T21:02:04.929 INFO:journalctl@ceph.mon.a.trial090.stdout: ** Compaction Stats [default] ** 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 157.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-19T21:02:04.930 INFO:journalctl@ceph.mon.a.trial090.stdout: Cumulative compaction: 0.00 GB write, 27.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: Interval compaction: 0.00 GB write, 27.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: Block cache BinnedLRUCache@0x55beb64a6010#2 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 2.8e-05 secs_since: 0 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(2,0.95 KB,0.000181794%) 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: starting mon.a rank 0 at public addrs [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] at bind addrs [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???) e1 preinit fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).mds e1 new map 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).mds e1 print_map 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: e1 2026-02-19T21:02:04.931 INFO:journalctl@ceph.mon.a.trial090.stdout: btime 2026-02-19T21:02:03:870646+0000 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout: legacy client fscid: -1 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout: 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout: No filesystems configured 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: monmap epoch 1 2026-02-19T21:02:04.932 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: last_changed 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: min_mon_release 20 (tentacle) 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: election_strategy: 1 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: fsmap 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: osdmap e1: 0 total, 0 up, 0 in 2026-02-19T21:02:04.933 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:04 trial090 ceph-mon[31759]: mgrmap e1: no daemons active 2026-02-19T21:02:04.993 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x 2026-02-19T21:02:04.994 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Failed to reset failed state of unit ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service: Unit ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service not loaded. 2026-02-19T21:02:05.115 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stderr Created symlink '/etc/systemd/system/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460.target.wants/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service' → '/etc/systemd/system/ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@.service'. 2026-02-19T21:02:05.226 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service - Ceph mgr.x for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:02:05.266 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T21:02:05.266 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-19T21:02:05.270 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T21:02:05.270 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-19T21:02:05.271 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-19T21:02:05.271 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to enable service . firewalld.service is not available 2026-02-19T21:02:05.275 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-19T21:02:05.276 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout disabled 2026-02-19T21:02:05.280 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-19T21:02:05.301 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout inactive 2026-02-19T21:02:05.302 INFO:teuthology.orchestra.run.trial090.stdout:firewalld.service is not enabled 2026-02-19T21:02:05.302 INFO:teuthology.orchestra.run.trial090.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-19T21:02:05.302 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr to start... 2026-02-19T21:02:05.302 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr... 2026-02-19T21:02:05.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:05.461 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsid": "34db945f-0dd6-11f1-890f-d404e6e7d460", 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "health": { 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 0 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-19T21:02:05.462 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "a" 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-19T21:02:05.463 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-19T21:02:05.464 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "btime": "2026-02-19T21:02:03:870646+0000", 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-19T21:02:05.465 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modified": "2026-02-19T21:02:03.870992+0000", 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-19T21:02:05.466 INFO:teuthology.orchestra.run.trial090.stdout:mgr not available, waiting (1/15)... 2026-02-19T21:02:05.577 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 podman[32020]: 2026-02-19 21:02:05.226168833 +0000 UTC m=+0.015849350 container create 9018e41f4c5ba9d99cc5420d1307676e8a687069c66ffe3b1a12d929cc14ed86 (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.41.3, version=10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:02:05.577 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 podman[32020]: 2026-02-19 21:02:05.25325297 +0000 UTC m=+0.042933487 container init 9018e41f4c5ba9d99cc5420d1307676e8a687069c66ffe3b1a12d929cc14ed86 (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, version=10, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image) 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 podman[32020]: 2026-02-19 21:02:05.255098365 +0000 UTC m=+0.044779363 container start 9018e41f4c5ba9d99cc5420d1307676e8a687069c66ffe3b1a12d929cc14ed86 (image=quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, io.buildah.version=1.41.3, version=10, license=BSD-3-Clause, summary=Rocky Linux Base image, name=rockylinux, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 bash[32020]: 9018e41f4c5ba9d99cc5420d1307676e8a687069c66ffe3b1a12d929cc14ed86 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 podman[32020]: 2026-02-19 21:02:05.219306925 +0000 UTC m=+0.008987442 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service - Ceph mgr.x for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.279+0000 7f613b620fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.371+0000 7f613b620fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-19T21:02:05.578 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.575+0000 7f613b620fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-19T21:02:05.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:05 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2081035371' entity='client.admin' 2026-02-19T21:02:05.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:05 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1471439678' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-19T21:02:05.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.577+0000 7f613b620fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.601+0000 7f613b620fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.607+0000 7f613b620fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.610+0000 7f613b620fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.613+0000 7f613b620fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.614+0000 7f613b620fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.616+0000 7f613b620fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.618+0000 7f613b620fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.647+0000 7f613b620fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.659+0000 7f613b620fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.668+0000 7f613b620fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-19T21:02:05.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.672+0000 7f613b620fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.675+0000 7f613b620fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.676+0000 7f613b620fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.676+0000 7f613b620fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.806+0000 7f613b620fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.809+0000 7f613b620fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.817+0000 7f613b620fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.819+0000 7f613b620fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.820+0000 7f613b620fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-19T21:02:05.908 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.823+0000 7f613b620fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-19T21:02:06.406 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.964+0000 7f613b620fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-19T21:02:06.406 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.973+0000 7f613b620fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-19T21:02:06.406 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.980+0000 7f613b620fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-19T21:02:06.407 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:05 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:05.983+0000 7f613b620fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-19T21:02:06.407 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:06 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:06.021+0000 7f613b620fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-19T21:02:06.407 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:06 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:06.050+0000 7f613b620fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-19T21:02:06.407 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:06 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:06.056+0000 7f613b620fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-19T21:02:06.407 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:06 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:06.057+0000 7f613b620fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-19T21:02:06.407 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:06 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:06.059+0000 7f613b620fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-19T21:02:07.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: Activating manager daemon x 2026-02-19T21:02:07.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: mgrmap e2: x(active, starting, since 0.00224373s) 2026-02-19T21:02:07.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:07.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:07.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: Manager daemon x is now available 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:07.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:06 trial090 ceph-mon[31759]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:07.732 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:07.732 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-19T21:02:07.732 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsid": "34db945f-0dd6-11f1-890f-d404e6e7d460", 2026-02-19T21:02:07.732 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "health": { 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 0 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "a" 2026-02-19T21:02:07.733 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-19T21:02:07.734 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.735 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "btime": "2026-02-19T21:02:03:870646+0000", 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ], 2026-02-19T21:02:07.736 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "modified": "2026-02-19T21:02:03.870992+0000", 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout }, 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-19T21:02:07.737 INFO:teuthology.orchestra.run.trial090.stdout:mgr is available 2026-02-19T21:02:07.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:07.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [global] 2026-02-19T21:02:07.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout fsid = 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:07.951 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.90:3300,v1:10.20.193.90:6789] 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout [osd] 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-19T21:02:07.952 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-19T21:02:07.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-19T21:02:07.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-19T21:02:07.953 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-19T21:02:07.953 INFO:teuthology.orchestra.run.trial090.stdout:Enabling cephadm module... 2026-02-19T21:02:08.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:08 trial090 ceph-mon[31759]: mgrmap e3: x(active, since 1.00507s) 2026-02-19T21:02:08.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:08 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3448957455' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-19T21:02:08.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:08 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3744674064' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-19T21:02:09.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:09 trial090 ceph-mon[31759]: mgrmap e4: x(active, since 2s) 2026-02-19T21:02:09.336 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:09 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2361991063' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-19T21:02:09.336 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: ignoring --setuser ceph since I am not root 2026-02-19T21:02:09.336 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: ignoring --setgroup ceph since I am not root 2026-02-19T21:02:09.337 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.104+0000 7fa843e11fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-19T21:02:09.337 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.195+0000 7fa843e11fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-19T21:02:09.359 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for the mgr to restart... 2026-02-19T21:02:09.360 INFO:teuthology.orchestra.run.trial090.stdout:Waiting for mgr epoch 5... 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.395+0000 7fa843e11fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.396+0000 7fa843e11fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.421+0000 7fa843e11fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.428+0000 7fa843e11fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.430+0000 7fa843e11fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.433+0000 7fa843e11fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.434+0000 7fa843e11fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.436+0000 7fa843e11fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.438+0000 7fa843e11fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-19T21:02:09.619 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.467+0000 7fa843e11fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.479+0000 7fa843e11fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.488+0000 7fa843e11fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.493+0000 7fa843e11fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.495+0000 7fa843e11fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.496+0000 7fa843e11fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.497+0000 7fa843e11fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-19T21:02:09.620 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.618+0000 7fa843e11fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.620+0000 7fa843e11fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.628+0000 7fa843e11fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.630+0000 7fa843e11fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.632+0000 7fa843e11fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.634+0000 7fa843e11fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.781+0000 7fa843e11fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.790+0000 7fa843e11fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.796+0000 7fa843e11fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.799+0000 7fa843e11fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.836+0000 7fa843e11fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.865+0000 7fa843e11fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-19T21:02:09.872 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.871+0000 7fa843e11fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.872+0000 7fa843e11fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:09 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:09.874+0000 7fa843e11fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2361991063' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: mgrmap e5: x(active, since 3s) 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/452531308' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: Active manager daemon x restarted 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: Activating manager daemon x 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: osdmap e2: 0 total, 0 up, 0 in 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: mgrmap e6: x(active, starting, since 0.00273723s) 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:10 trial090 ceph-mon[31759]: Manager daemon x is now available 2026-02-19T21:02:10.906 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout { 2026-02-19T21:02:10.906 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-19T21:02:10.906 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-19T21:02:10.906 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout } 2026-02-19T21:02:10.906 INFO:teuthology.orchestra.run.trial090.stdout:mgr epoch 5 is available 2026-02-19T21:02:10.906 INFO:teuthology.orchestra.run.trial090.stdout:Verifying orchestrator module is enabled... 2026-02-19T21:02:11.018 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:10 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: Client ('10.20.193.90', 38666) lost — peer dropped the TLS connection suddenly, during handshake: (8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:998)') 2026-02-19T21:02:11.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:11 trial090 ceph-mon[31759]: mgrmap e7: x(active, since 1.00385s) 2026-02-19T21:02:12.143 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-19T21:02:12.143 INFO:teuthology.orchestra.run.trial090.stdout:Setting orchestrator backend to cephadm... 2026-02-19T21:02:12.373 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:12 trial090 ceph-mon[31759]: Optimize plan auto_2026-02-19_21:02:09, mode upmap, max misplaced 0.050000 2026-02-19T21:02:12.373 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:12 trial090 ceph-mon[31759]: No pools available 2026-02-19T21:02:12.373 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:12 trial090 ceph-mon[31759]: Found migration_current of "None". Setting to last migration. 2026-02-19T21:02:12.373 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:12 trial090 ceph-mon[31759]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-19T21:02:12.373 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:12 trial090 ceph-mon[31759]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-19T21:02:12.373 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:12 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/296525735' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-19T21:02:12.610 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-19T21:02:12.610 INFO:teuthology.orchestra.run.trial090.stdout:Generating ssh key... 2026-02-19T21:02:12.888 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: Generating public/private ed25519 key pair. 2026-02-19T21:02:12.888 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: Your identification has been saved in /tmp/tmp8j4aink6/key 2026-02-19T21:02:12.888 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: Your public key has been saved in /tmp/tmp8j4aink6/key.pub 2026-02-19T21:02:12.888 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: The key fingerprint is: 2026-02-19T21:02:12.888 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: SHA256:nqtFeVQA51hvHgfaErR6vZhwtxlqb8Ru+Dl3UyBwUfU ceph-34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:12.888 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: The key's randomart image is: 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: +--[ED25519 256]--+ 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | .o*.+o...| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | =.B.. .| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | . *o= . E| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | + =.o. | 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | S +.=. . | 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | o * =o= .| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | + =++ .| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | . o..=....| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: | ... ++o ..| 2026-02-19T21:02:12.889 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:12 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: +----[SHA256]-----+ 2026-02-19T21:02:13.072 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:13.073 INFO:teuthology.orchestra.run.trial090.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-19T21:02:13.073 INFO:teuthology.orchestra.run.trial090.stdout:Adding key to root@localhost authorized_keys... 2026-02-19T21:02:13.073 INFO:teuthology.orchestra.run.trial090.stdout:Adding host trial090... 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/296525735' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: mgrmap e8: x(active, since 2s) 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:13.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:13.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:13.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:13 trial090 ceph-mon[31759]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:14.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:14 trial090 ceph-mon[31759]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "addr": "10.20.193.90", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:15.023 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Added host 'trial090' with addr '10.20.193.90' 2026-02-19T21:02:15.023 INFO:teuthology.orchestra.run.trial090.stdout:Deploying unmanaged mon service... 2026-02-19T21:02:15.256 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-19T21:02:15.257 INFO:teuthology.orchestra.run.trial090.stdout:Deploying unmanaged mgr service... 2026-02-19T21:02:15.506 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-19T21:02:15.738 INFO:teuthology.orchestra.run.trial090.stdout:Saving cluster configuration to /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/config directory 2026-02-19T21:02:16.015 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:16.015 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:16.015 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:16.015 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:16.015 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:16.016 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:16.016 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:15 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/466949414' entity='client.admin' 2026-02-19T21:02:16.027 INFO:teuthology.orchestra.run.trial090.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-19T21:02:16.027 INFO:teuthology.orchestra.run.trial090.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-19T21:02:16.027 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.027 INFO:teuthology.orchestra.run.trial090.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout:Or, if you are only running a single cluster on this host: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: ceph telemetry on 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout:For more information see: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.028 INFO:teuthology.orchestra.run.trial090.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-19T21:02:16.029 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:16.029 INFO:teuthology.orchestra.run.trial090.stdout:Bootstrap complete. 2026-02-19T21:02:16.033 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout static 2026-02-19T21:02:16.037 INFO:teuthology.orchestra.run.trial090.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-19T21:02:16.038 INFO:teuthology.orchestra.run.trial090.stdout:systemctl: stdout failed 2026-02-19T21:02:16.038 INFO:teuthology.orchestra.run.trial090.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-19T21:02:16.207 INFO:tasks.cephadm:Fetching config... 2026-02-19T21:02:16.208 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:16.208 DEBUG:teuthology.orchestra.run.trial090:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-19T21:02:16.226 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-19T21:02:16.227 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:16.227 DEBUG:teuthology.orchestra.run.trial090:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-19T21:02:16.285 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-19T21:02:16.285 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:16.285 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-19T21:02:16.352 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-19T21:02:16.352 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:16.352 DEBUG:teuthology.orchestra.run.trial090:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-19T21:02:16.410 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-19T21:02:16.410 DEBUG:teuthology.orchestra.run.trial090:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-19T21:02:16.487 INFO:teuthology.orchestra.run.trial090.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:16.499 DEBUG:teuthology.orchestra.run.trial105:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-19T21:02:16.538 INFO:teuthology.orchestra.run.trial105.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:16.550 DEBUG:teuthology.orchestra.run.trial175:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-19T21:02:16.588 INFO:teuthology.orchestra.run.trial175.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBHG2GAf8sEPvIHRFRFBKjmKgrf4J/JOvZnL4DVVf1WL ceph-34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:16.599 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-19T21:02:16.725 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:16.985 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-19T21:02:16.986 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-19T21:02:17.111 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:17.224 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:17 trial090 ceph-mon[31759]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:17.224 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:17 trial090 ceph-mon[31759]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:17.224 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:17 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4227592922' entity='client.admin' 2026-02-19T21:02:17.224 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:17 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:17.224 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:17 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:17.225 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:17 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/490351799' entity='client.admin' 2026-02-19T21:02:17.562 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial105 2026-02-19T21:02:17.562 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:02:17.562 DEBUG:teuthology.orchestra.run.trial105:> dd of=/etc/ceph/ceph.conf 2026-02-19T21:02:17.582 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:02:17.582 DEBUG:teuthology.orchestra.run.trial105:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:17.640 INFO:tasks.cephadm:Adding host trial105 to orchestrator... 2026-02-19T21:02:17.640 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch host add trial105 2026-02-19T21:02:17.763 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:18.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:18 trial090 ceph-mon[31759]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial105", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:19.768 INFO:teuthology.orchestra.run.trial090.stdout:Added host 'trial105' with addr '10.20.193.105' 2026-02-19T21:02:19.811 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-19T21:02:19.934 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:20.152 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:20.152 INFO:teuthology.orchestra.run.trial090.stdout:[{"addr": "10.20.193.90", "hostname": "trial090", "labels": [], "status": ""}, {"addr": "10.20.193.105", "hostname": "trial105", "labels": [], "status": ""}] 2026-02-19T21:02:20.190 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial175 2026-02-19T21:02:20.190 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:02:20.191 DEBUG:teuthology.orchestra.run.trial175:> dd of=/etc/ceph/ceph.conf 2026-02-19T21:02:20.211 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:02:20.211 DEBUG:teuthology.orchestra.run.trial175:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:20.270 INFO:tasks.cephadm:Adding host trial175 to orchestrator... 2026-02-19T21:02:20.270 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch host add trial175 2026-02-19T21:02:20.393 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:21.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:20 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:21.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:20 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:21.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:20 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:21.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:20 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:22.288 INFO:teuthology.orchestra.run.trial090.stdout:Added host 'trial175' with addr '10.20.193.175' 2026-02-19T21:02:22.288 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:02:22.288 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial175", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:22.289 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:22 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:22.328 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-19T21:02:22.449 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:22.663 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:22.663 INFO:teuthology.orchestra.run.trial090.stdout:[{"addr": "10.20.193.90", "hostname": "trial090", "labels": [], "status": ""}, {"addr": "10.20.193.105", "hostname": "trial105", "labels": [], "status": ""}, {"addr": "10.20.193.175", "hostname": "trial175", "labels": [], "status": ""}] 2026-02-19T21:02:22.702 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-19T21:02:22.702 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd crush tunables default 2026-02-19T21:02:22.824 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:23.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:23 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1934478780' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-19T21:02:23.815 INFO:teuthology.orchestra.run.trial090.stderr:adjusted tunables profile to default 2026-02-19T21:02:23.969 INFO:tasks.cephadm:Adding mon.a on trial090 2026-02-19T21:02:23.970 INFO:tasks.cephadm:Adding mon.b on trial105 2026-02-19T21:02:23.970 INFO:tasks.cephadm:Adding mon.c on trial175 2026-02-19T21:02:23.970 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch apply mon '3;trial090:10.20.193.90=a;trial105:10.20.193.105=b;trial175:10.20.193.175=c' 2026-02-19T21:02:24.107 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T21:02:24.107 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T21:02:24.334 INFO:teuthology.orchestra.run.trial175.stdout:Scheduled mon update... 2026-02-19T21:02:24.373 DEBUG:teuthology.orchestra.run.trial105:mon.b> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.b.service 2026-02-19T21:02:24.376 DEBUG:teuthology.orchestra.run.trial175:mon.c> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.c.service 2026-02-19T21:02:24.379 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-19T21:02:24.379 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph mon dump -f json 2026-02-19T21:02:24.561 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T21:02:24.561 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-19T21:02:24.806 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:02:24.806 INFO:teuthology.orchestra.run.trial175.stdout:{"epoch":1,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","modified":"2026-02-19T21:02:02.765315Z","created":"2026-02-19T21:02:02.765315Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:02:765325+0000","crush_location":[]}],"quorum":[0]} 2026-02-19T21:02:24.806 INFO:teuthology.orchestra.run.trial175.stderr:dumped monmap epoch 1 2026-02-19T21:02:25.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:25.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1934478780' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-19T21:02:25.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial175", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:25.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:24 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:25.845 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-19T21:02:25.845 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph mon dump -f json 2026-02-19T21:02:26.124 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial090:10.20.193.90=a;trial105:10.20.193.105=b;trial175:10.20.193.175=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/2048912537' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:25 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:26.274 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.c.service - Ceph mon.c for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:02:26.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 podman[34068]: 2026-02-19 21:02:26.29029136 +0000 UTC m=+0.015669729 container create 84258d423efe1882690a67bcf28ee6c4c1d2e5b43bdc0aa6be6a9f104a5e1134 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-c, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, ceph=True, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause) 2026-02-19T21:02:26.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 podman[34068]: 2026-02-19 21:02:26.321337879 +0000 UTC m=+0.046716248 container init 84258d423efe1882690a67bcf28ee6c4c1d2e5b43bdc0aa6be6a9f104a5e1134 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-c, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, license=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, name=rockylinux, version=10, io.buildah.version=1.41.3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux) 2026-02-19T21:02:26.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 podman[34068]: 2026-02-19 21:02:26.323033515 +0000 UTC m=+0.048411874 container start 84258d423efe1882690a67bcf28ee6c4c1d2e5b43bdc0aa6be6a9f104a5e1134 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-c, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, license=BSD-3-Clause) 2026-02-19T21:02:26.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 bash[34068]: 84258d423efe1882690a67bcf28ee6c4c1d2e5b43bdc0aa6be6a9f104a5e1134 2026-02-19T21:02:26.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 podman[34068]: 2026-02-19 21:02:26.284177229 +0000 UTC m=+0.009555598 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:02:26.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.c.service - Ceph mon.c for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: set uid:gid to 167:167 (ceph:ceph) 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: pidfile_write: ignore empty --pid-file 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: load: jerasure load: lrc 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: RocksDB version: 7.9.2 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Git sha 0 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Compile date 2026-02-07 00:48:56 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: DB SUMMARY 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: DB Session ID: RX1VXU5CP7QCOZ7CPTQR 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: CURRENT file: CURRENT 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: IDENTITY file: IDENTITY 2026-02-19T21:02:26.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 519 ; 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.error_if_exists: 0 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.create_if_missing: 0 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.paranoid_checks: 1 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.env: 0x5556cdafa280 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.fs: PosixFileSystem 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.info_log: 0x5556fdc36e00 2026-02-19T21:02:26.771 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_file_opening_threads: 16 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.statistics: (nil) 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.use_fsync: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_log_file_size: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.keep_log_file_num: 1000 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.recycle_log_file_num: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.allow_fallocate: 1 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.allow_mmap_reads: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.allow_mmap_writes: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.use_direct_reads: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-19T21:02:26.772 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.create_missing_column_families: 0 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.db_log_dir: 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.wal_dir: 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.advise_random_on_open: 1 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.db_write_buffer_size: 0 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.write_buffer_manager: 0x5556fdc2dc20 2026-02-19T21:02:26.773 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.rate_limiter: (nil) 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.wal_recovery_mode: 2 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.enable_thread_tracking: 0 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.enable_pipelined_write: 0 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.unordered_write: 0 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-19T21:02:26.774 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.row_cache: None 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.wal_filter: None 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.allow_ingest_behind: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.two_write_queues: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.manual_wal_flush: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.wal_compression: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.atomic_flush: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.log_readahead_size: 0 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-19T21:02:26.775 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.best_efforts_recovery: 0 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.allow_data_in_errors: 0 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.db_host_id: __hostname__ 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_background_jobs: 2 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_background_compactions: -1 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_subcompactions: 1 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_total_wal_size: 0 2026-02-19T21:02:26.776 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_open_files: -1 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bytes_per_sync: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_readahead_size: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_background_flushes: -1 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Compression algorithms supported: 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kZSTD supported: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kXpressCompression supported: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kBZip2Compression supported: 0 2026-02-19T21:02:26.777 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kLZ4Compression supported: 1 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kZlibCompression supported: 1 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kLZ4HCCompression supported: 1 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: kSnappyCompression supported: 1 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.merge_operator: 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_filter: None 2026-02-19T21:02:26.778 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_filter_factory: None 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.sst_partitioner_factory: None 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5556fdc378c0) 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: cache_index_and_filter_blocks: 1 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: pin_top_level_index_and_filter: 1 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: index_type: 0 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: data_block_index_type: 0 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: index_shortening: 1 2026-02-19T21:02:26.779 INFO:journalctl@ceph.mon.c.trial175.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: checksum: 4 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: no_block_cache: 0 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: block_cache: 0x5556fdc92010 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: block_cache_name: BinnedLRUCache 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: block_cache_options: 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: capacity : 536870912 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: num_shard_bits : 4 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: strict_capacity_limit : 0 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: high_pri_pool_ratio: 0.000 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: block_cache_compressed: (nil) 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: persistent_cache: (nil) 2026-02-19T21:02:26.780 INFO:journalctl@ceph.mon.c.trial175.stdout: block_size: 4096 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: block_size_deviation: 10 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: block_restart_interval: 16 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: index_block_restart_interval: 1 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: metadata_block_size: 4096 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: partition_filters: 0 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: use_delta_encoding: 1 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: filter_policy: bloomfilter 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: whole_key_filtering: 1 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: verify_compression: 0 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: read_amp_bytes_per_bit: 0 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: format_version: 5 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: enable_index_compression: 1 2026-02-19T21:02:26.781 INFO:journalctl@ceph.mon.c.trial175.stdout: block_align: 0 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout: max_auto_readahead_size: 262144 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout: prepopulate_block_cache: 0 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout: initial_auto_readahead_size: 8192 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout: num_file_reads_for_auto_readahead: 2 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.write_buffer_size: 33554432 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_write_buffer_number: 2 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression: NoCompression 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression: Disabled 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.prefix_extractor: nullptr 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.num_levels: 7 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-19T21:02:26.782 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.level: 32767 2026-02-19T21:02:26.783 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.strategy: 0 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.enabled: false 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.target_file_size_base: 67108864 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-19T21:02:26.784 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.arena_block_size: 1048576 2026-02-19T21:02:26.785 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.disable_auto_compactions: 0 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-19T21:02:26.786 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.inplace_update_support: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.bloom_locality: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.max_successive_merges: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.paranoid_file_checks: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.force_consistency_checks: 1 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.report_bg_io_stats: 0 2026-02-19T21:02:26.787 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.ttl: 2592000 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.enable_blob_files: false 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.min_blob_size: 0 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.blob_file_size: 268435456 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.blob_file_starting_level: 0 2026-02-19T21:02:26.788 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5a8a4278-97ac-4eeb-971a-1024388ff88a 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534946338193, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534946338911, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1655, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 531, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 409, "raw_average_value_size": 81, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771534946, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5a8a4278-97ac-4eeb-971a-1024388ff88a", "db_session_id": "RX1VXU5CP7QCOZ7CPTQR", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534946338962, "job": 1, "event": "recovery_finished"} 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5556fdc52e00 2026-02-19T21:02:26.789 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: DB pointer 0x5556fea5c000 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: ** DB Stats ** 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: ** Compaction Stats [default] ** 2026-02-19T21:02:26.790 INFO:journalctl@ceph.mon.c.trial175.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: L0 1/0 1.62 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: Sum 1/0 1.62 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: ** Compaction Stats [default] ** 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: 2026-02-19T21:02:26.791 INFO:journalctl@ceph.mon.c.trial175.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Cumulative compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Interval compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Block cache BinnedLRUCache@0x5556fdc92010#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-19T21:02:26.792 INFO:journalctl@ceph.mon.c.trial175.stdout: 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c does not exist in monmap, will attempt to join an existing cluster 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: using public_addr v2:10.20.193.175:0/0 -> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: starting mon.c rank -1 at public addrs [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] at bind addrs [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(???) e0 preinit fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).mds e1 new map 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).mds e1 print_map 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout: e1 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout: btime 2026-02-19T21:02:03:870646+0000 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-19T21:02:26.793 INFO:journalctl@ceph.mon.c.trial175.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout: legacy client fscid: -1 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout: 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout: No filesystems configured 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:26.794 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mkfs 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: monmap epoch 1 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: last_changed 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: min_mon_release 20 (tentacle) 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: election_strategy: 1 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: fsmap 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: osdmap e1: 0 total, 0 up, 0 in 2026-02-19T21:02:26.795 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e1: no daemons active 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2081035371' entity='client.admin' 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1471439678' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Activating manager daemon x 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e2: x(active, starting, since 0.00224373s) 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Manager daemon x is now available 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:26.796 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e3: x(active, since 1.00507s) 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3448957455' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3744674064' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e4: x(active, since 2s) 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2361991063' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2361991063' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e5: x(active, since 3s) 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/452531308' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-19T21:02:26.797 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Active manager daemon x restarted 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Activating manager daemon x 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: osdmap e2: 0 total, 0 up, 0 in 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e6: x(active, starting, since 0.00273723s) 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Manager daemon x is now available 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.798 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e7: x(active, since 1.00385s) 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Optimize plan auto_2026-02-19_21:02:09, mode upmap, max misplaced 0.050000 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: No pools available 2026-02-19T21:02:26.799 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: Found migration_current of "None". Setting to last migration. 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/296525735' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/296525735' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mgrmap e8: x(active, since 2s) 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.800 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "addr": "10.20.193.90", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/466949414' entity='client.admin' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4227592922' entity='client.admin' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.801 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/490351799' entity='client.admin' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.802 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial105", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial175", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:26.803 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1934478780' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1934478780' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.804 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial175", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial090:10.20.193.90=a;trial105:10.20.193.105=b;trial175:10.20.193.175=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/2048912537' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:26.805 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:26 trial175 ceph-mon[34116]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-19T21:02:31.364 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:02:31.364 INFO:teuthology.orchestra.run.trial175.stdout:{"epoch":2,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","modified":"2026-02-19T21:02:26.356930Z","created":"2026-02-19T21:02:02.765315Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:02:765325+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:3300","nonce":0},{"type":"v1","addr":"10.20.193.175:6789","nonce":0}]},"addr":"10.20.193.175:6789/0","public_addr":"10.20.193.175:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:26:356927+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-19T21:02:31.365 INFO:teuthology.orchestra.run.trial175.stderr:dumped monmap epoch 2 2026-02-19T21:02:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: mon.a calling monitor election 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1842274047' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: mon.c calling monitor election 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: monmap epoch 2 2026-02-19T21:02:31.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: last_changed 2026-02-19T21:02:26.356930+0000 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: min_mon_release 20 (tentacle) 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: election_strategy: 1 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: 1: [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon.c 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: fsmap 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: mgrmap e8: x(active, since 21s) 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: overall HEALTH_OK 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:31.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:31.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:31 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:31.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:31.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: mon.a calling monitor election 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1842274047' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: mon.c calling monitor election 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-19T21:02:31.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: monmap epoch 2 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: last_changed 2026-02-19T21:02:26.356930+0000 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: min_mon_release 20 (tentacle) 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: election_strategy: 1 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: 1: [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon.c 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: fsmap 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: mgrmap e8: x(active, since 21s) 2026-02-19T21:02:31.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: overall HEALTH_OK 2026-02-19T21:02:31.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:31.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:31.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:31.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:31 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:32.406 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-19T21:02:32.406 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph mon dump -f json 2026-02-19T21:02:32.531 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:02:32.611 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.b.service - Ceph mon.b for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:02:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:32 trial175 ceph-mon[34116]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:32 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:32.777 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:02:32.777 INFO:teuthology.orchestra.run.trial175.stdout:{"epoch":2,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","modified":"2026-02-19T21:02:26.356930Z","created":"2026-02-19T21:02:02.765315Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:02:765325+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:3300","nonce":0},{"type":"v1","addr":"10.20.193.175:6789","nonce":0}]},"addr":"10.20.193.175:6789/0","public_addr":"10.20.193.175:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:26:356927+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-19T21:02:32.777 INFO:teuthology.orchestra.run.trial175.stderr:dumped monmap epoch 2 2026-02-19T21:02:32.865 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 podman[33855]: 2026-02-19 21:02:32.611823956 +0000 UTC m=+0.016509964 container create e39c519d844a1d0e9d3c8a983874570baba0b6edca71bbfb36a519dfaf3b3144 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-b, io.buildah.version=1.41.3, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default) 2026-02-19T21:02:32.865 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 podman[33855]: 2026-02-19 21:02:32.605025375 +0000 UTC m=+0.009711383 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:02:32.865 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 podman[33855]: 2026-02-19 21:02:32.833079856 +0000 UTC m=+0.237765965 container init e39c519d844a1d0e9d3c8a983874570baba0b6edca71bbfb36a519dfaf3b3144 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-b, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, io.buildah.version=1.41.3, version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-19T21:02:32.865 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 podman[33855]: 2026-02-19 21:02:32.835562375 +0000 UTC m=+0.240248383 container start e39c519d844a1d0e9d3c8a983874570baba0b6edca71bbfb36a519dfaf3b3144 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-b, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, OSD_FLAVOR=default, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, io.buildah.version=1.41.3) 2026-02-19T21:02:32.865 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: set uid:gid to 167:167 (ceph:ceph) 2026-02-19T21:02:32.865 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: ceph version 20.3.0-5184-ga1ac97f8 (a1ac97f8290bb2544f44f608df68f43689827c55) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: pidfile_write: ignore empty --pid-file 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: load: jerasure load: lrc 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: RocksDB version: 7.9.2 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Git sha 0 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Compile date 2026-02-07 00:48:56 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: DB SUMMARY 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: DB Session ID: 4IMGD0C0V3CNJZMAFTSB 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: CURRENT file: CURRENT 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: IDENTITY file: IDENTITY 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2026-02-19T21:02:32.866 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 652 ; 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.error_if_exists: 0 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.create_if_missing: 0 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.paranoid_checks: 1 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.env: 0x556d074a1280 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.fs: PosixFileSystem 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.info_log: 0x556d1a822e00 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_file_opening_threads: 16 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.statistics: (nil) 2026-02-19T21:02:32.867 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.use_fsync: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_log_file_size: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.keep_log_file_num: 1000 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.recycle_log_file_num: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.allow_fallocate: 1 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.allow_mmap_reads: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.allow_mmap_writes: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.use_direct_reads: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.create_missing_column_families: 0 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.db_log_dir: 2026-02-19T21:02:32.868 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.wal_dir: 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.advise_random_on_open: 1 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.db_write_buffer_size: 0 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.write_buffer_manager: 0x556d1a819c20 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-19T21:02:32.869 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.rate_limiter: (nil) 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.wal_recovery_mode: 2 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.enable_thread_tracking: 0 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.enable_pipelined_write: 0 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.unordered_write: 0 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.row_cache: None 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.wal_filter: None 2026-02-19T21:02:32.870 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.allow_ingest_behind: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.two_write_queues: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.manual_wal_flush: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.wal_compression: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.atomic_flush: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.log_readahead_size: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.best_efforts_recovery: 0 2026-02-19T21:02:32.871 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.allow_data_in_errors: 0 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.db_host_id: __hostname__ 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_background_jobs: 2 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_background_compactions: -1 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_subcompactions: 1 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_total_wal_size: 0 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-19T21:02:32.872 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_open_files: -1 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bytes_per_sync: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_readahead_size: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_background_flushes: -1 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Compression algorithms supported: 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kZSTD supported: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kXpressCompression supported: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kBZip2Compression supported: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-19T21:02:32.873 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kLZ4Compression supported: 1 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kZlibCompression supported: 1 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kLZ4HCCompression supported: 1 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: kSnappyCompression supported: 1 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.merge_operator: 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_filter: None 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_filter_factory: None 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.sst_partitioner_factory: None 2026-02-19T21:02:32.874 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556d1a8238c0) 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: cache_index_and_filter_blocks: 1 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: pin_top_level_index_and_filter: 1 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: index_type: 0 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: data_block_index_type: 0 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: index_shortening: 1 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-19T21:02:32.875 INFO:journalctl@ceph.mon.b.trial105.stdout: checksum: 4 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: no_block_cache: 0 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_cache: 0x556d1a87e010 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_cache_name: BinnedLRUCache 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_cache_options: 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: capacity : 536870912 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: num_shard_bits : 4 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: strict_capacity_limit : 0 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: high_pri_pool_ratio: 0.000 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_cache_compressed: (nil) 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: persistent_cache: (nil) 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_size: 4096 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_size_deviation: 10 2026-02-19T21:02:32.876 INFO:journalctl@ceph.mon.b.trial105.stdout: block_restart_interval: 16 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: index_block_restart_interval: 1 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: metadata_block_size: 4096 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: partition_filters: 0 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: use_delta_encoding: 1 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: filter_policy: bloomfilter 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: whole_key_filtering: 1 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: verify_compression: 0 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: read_amp_bytes_per_bit: 0 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: format_version: 5 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: enable_index_compression: 1 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: block_align: 0 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: max_auto_readahead_size: 262144 2026-02-19T21:02:32.877 INFO:journalctl@ceph.mon.b.trial105.stdout: prepopulate_block_cache: 0 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout: initial_auto_readahead_size: 8192 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout: num_file_reads_for_auto_readahead: 2 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.write_buffer_size: 33554432 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_write_buffer_number: 2 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression: NoCompression 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression: Disabled 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.prefix_extractor: nullptr 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.num_levels: 7 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-19T21:02:32.878 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.level: 32767 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.strategy: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-19T21:02:32.879 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.enabled: false 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.target_file_size_base: 67108864 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-19T21:02:32.880 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.arena_block_size: 1048576 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-19T21:02:32.881 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.disable_auto_compactions: 0 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-19T21:02:32.882 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.inplace_update_support: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.bloom_locality: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.max_successive_merges: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.paranoid_file_checks: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.force_consistency_checks: 1 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.report_bg_io_stats: 0 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.ttl: 2592000 2026-02-19T21:02:32.883 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.enable_blob_files: false 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.min_blob_size: 0 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.blob_file_size: 268435456 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.blob_file_starting_level: 0 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-19T21:02:32.884 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ce73729f-edb2-4e7d-9327-0ce66ef1d31a 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534952851376, "job": 1, "event": "recovery_started", "wal_files": [4]} 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534952851760, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1788, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 664, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 542, "raw_average_value_size": 108, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771534952, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ce73729f-edb2-4e7d-9327-0ce66ef1d31a", "db_session_id": "4IMGD0C0V3CNJZMAFTSB", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771534952851818, "job": 1, "event": "recovery_finished"} 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556d1a83ee00 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: DB pointer 0x556d1b648000 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b does not exist in monmap, will attempt to join an existing cluster 2026-02-19T21:02:32.885 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: ** DB Stats ** 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: ** Compaction Stats [default] ** 2026-02-19T21:02:32.886 INFO:journalctl@ceph.mon.b.trial105.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: L0 1/0 1.75 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: Sum 1/0 1.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: ** Compaction Stats [default] ** 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: 2026-02-19T21:02:32.887 INFO:journalctl@ceph.mon.b.trial105.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Cumulative compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Interval compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Block cache BinnedLRUCache@0x556d1a87e010#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 5e-06 secs_since: 0 2026-02-19T21:02:32.888 INFO:journalctl@ceph.mon.b.trial105.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: using public_addr v2:10.20.193.105:0/0 -> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: starting mon.b rank -1 at public addrs [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] at bind addrs [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(???) e0 preinit fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).mds e1 new map 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).mds e1 print_map 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: e1 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: btime 2026-02-19T21:02:03:870646+0000 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-19T21:02:32.889 INFO:journalctl@ceph.mon.b.trial105.stdout: legacy client fscid: -1 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout: 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout: No filesystems configured 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e3 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).osd e3 crush map has features 288514050185494528, adjusting msgr requires 2026-02-19T21:02:32.890 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mkfs 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: monmap epoch 1 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: last_changed 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: min_mon_release 20 (tentacle) 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: election_strategy: 1 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: fsmap 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: osdmap e1: 0 total, 0 up, 0 in 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e1: no daemons active 2026-02-19T21:02:32.891 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2081035371' entity='client.admin' 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1471439678' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Activating manager daemon x 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e2: x(active, starting, since 0.00224373s) 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Manager daemon x is now available 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:32.892 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14100 10.20.193.90:0/2078916381' entity='mgr.x' 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e3: x(active, since 1.00507s) 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3448957455' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3744674064' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e4: x(active, since 2s) 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2361991063' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2361991063' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e5: x(active, since 3s) 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/452531308' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Active manager daemon x restarted 2026-02-19T21:02:32.893 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Activating manager daemon x 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: osdmap e2: 0 total, 0 up, 0 in 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e6: x(active, starting, since 0.00273723s) 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Manager daemon x is now available 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.894 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e7: x(active, since 1.00385s) 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Optimize plan auto_2026-02-19_21:02:09, mode upmap, max misplaced 0.050000 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: No pools available 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: Found migration_current of "None". Setting to last migration. 2026-02-19T21:02:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/296525735' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/296525735' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e8: x(active, since 2s) 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial090", "addr": "10.20.193.90", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/466949414' entity='client.admin' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4227592922' entity='client.admin' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/490351799' entity='client.admin' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:32.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial105", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial175", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.899 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.900 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.900 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:32.900 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:32.900 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:32.900 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.900 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1934478780' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1934478780' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:32.901 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial175", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial090:10.20.193.90=a;trial105:10.20.193.105=b;trial175:10.20.193.175=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/2048912537' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:32.902 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:32.903 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:32.903 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:32.903 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:32.903 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:32.903 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.a calling monitor election 2026-02-19T21:02:32.903 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1842274047' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:32.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:32 trial090 ceph-mon[31759]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:32.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:32 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.144 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.c calling monitor election 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-19T21:02:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: monmap epoch 2 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: last_changed 2026-02-19T21:02:26.356930+0000 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: min_mon_release 20 (tentacle) 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: election_strategy: 1 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: 1: [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon.c 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: fsmap 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mgrmap e8: x(active, since 21s) 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: overall HEALTH_OK 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 ceph-mon[33883]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 bash[33855]: e39c519d844a1d0e9d3c8a983874570baba0b6edca71bbfb36a519dfaf3b3144 2026-02-19T21:02:33.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:32 trial105 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.b.service - Ceph mon.b for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:02:33.819 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-19T21:02:33.820 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph mon dump -f json 2026-02-19T21:02:33.945 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:02:38.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:38.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:38.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: mon.a calling monitor election 2026-02-19T21:02:38.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: mon.c calling monitor election 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: mon.b calling monitor election 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: monmap epoch 3 2026-02-19T21:02:38.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: last_changed 2026-02-19T21:02:32.867117+0000 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: min_mon_release 20 (tentacle) 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: election_strategy: 1 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: 1: [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon.c 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: 2: [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] mon.b 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: fsmap 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: mgrmap e8: x(active, since 27s) 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: overall HEALTH_OK 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:37 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.196 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:38.196 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.196 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:38.196 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: mon.a calling monitor election 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: mon.c calling monitor election 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: mon.b calling monitor election 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: monmap epoch 3 2026-02-19T21:02:38.197 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: last_changed 2026-02-19T21:02:32.867117+0000 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: min_mon_release 20 (tentacle) 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: election_strategy: 1 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: 1: [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon.c 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: 2: [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] mon.b 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: fsmap 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: mgrmap e8: x(active, since 27s) 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: overall HEALTH_OK 2026-02-19T21:02:38.198 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.199 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.199 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.199 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:37 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:38.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: mon.a calling monitor election 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: mon.c calling monitor election 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: mon.b calling monitor election 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:38.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: monmap epoch 3 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: last_changed 2026-02-19T21:02:32.867117+0000 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: created 2026-02-19T21:02:02.765315+0000 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: min_mon_release 20 (tentacle) 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: election_strategy: 1 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: 0: [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] mon.a 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: 1: [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] mon.c 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: 2: [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] mon.b 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: fsmap 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: osdmap e3: 0 total, 0 up, 0 in 2026-02-19T21:02:38.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: mgrmap e8: x(active, since 27s) 2026-02-19T21:02:38.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: overall HEALTH_OK 2026-02-19T21:02:38.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:37 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:38.592 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:02:38.592 INFO:teuthology.orchestra.run.trial175.stdout:{"epoch":3,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","modified":"2026-02-19T21:02:32.867117Z","created":"2026-02-19T21:02:02.765315Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:3300","nonce":0},{"type":"v1","addr":"10.20.193.90:6789","nonce":0}]},"addr":"10.20.193.90:6789/0","public_addr":"10.20.193.90:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:02:765325+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:3300","nonce":0},{"type":"v1","addr":"10.20.193.175:6789","nonce":0}]},"addr":"10.20.193.175:6789/0","public_addr":"10.20.193.175:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:26:356927+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:3300","nonce":0},{"type":"v1","addr":"10.20.193.105:6789","nonce":0}]},"addr":"10.20.193.105:6789/0","public_addr":"10.20.193.105:6789/0","priority":0,"weight":0,"time_added":"2026-02-19T21:02:32:867116+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-19T21:02:38.592 INFO:teuthology.orchestra.run.trial175.stderr:dumped monmap epoch 3 2026-02-19T21:02:38.629 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-19T21:02:38.630 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-19T21:02:38.755 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:38.964 INFO:teuthology.orchestra.run.trial090.stdout:# minimal ceph.conf for 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:38.964 INFO:teuthology.orchestra.run.trial090.stdout:[global] 2026-02-19T21:02:38.964 INFO:teuthology.orchestra.run.trial090.stdout: fsid = 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:02:38.964 INFO:teuthology.orchestra.run.trial090.stdout: mon_host = [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] 2026-02-19T21:02:39.002 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-19T21:02:39.002 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:39.002 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.conf 2026-02-19T21:02:39.032 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:39.032 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:39.099 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:02:39.099 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/ceph/ceph.conf 2026-02-19T21:02:39.130 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:02:39.130 DEBUG:teuthology.orchestra.run.trial105:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.194 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1181257006' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.195 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:38 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1181257006' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.197 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:38 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:39.198 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:02:39.198 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/etc/ceph/ceph.conf 2026-02-19T21:02:39.228 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:02:39.228 DEBUG:teuthology.orchestra.run.trial175:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-19T21:02:39.297 INFO:tasks.cephadm:enabling module snap_schedule 2026-02-19T21:02:39.298 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2026-02-19T21:02:39.321 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.322 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1181257006' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:39.323 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:39.324 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:39.324 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:39.324 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:38 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:39.417 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:40.156 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:39 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:39.867+0000 7fa76dd9b6c0 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-19T21:02:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/416259123' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:40.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:40.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:40.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:40.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2467855699' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/416259123' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:40.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:40.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2467855699' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-19T21:02:40.293 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/416259123' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.293 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.293 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.293 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:40.294 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2467855699' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-19T21:02:40.329 INFO:tasks.cephadm:Adding mgr.x on trial090 2026-02-19T21:02:40.329 INFO:tasks.cephadm:Adding mgr.y on trial105 2026-02-19T21:02:40.329 INFO:tasks.cephadm:Adding mgr.z on trial175 2026-02-19T21:02:40.329 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch apply mgr '3;trial090=x;trial105=y;trial175=z' 2026-02-19T21:02:40.452 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:02:40.606 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: ignoring --setuser ceph since I am not root 2026-02-19T21:02:40.606 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: ignoring --setgroup ceph since I am not root 2026-02-19T21:02:40.606 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.316+0000 7fe06c796fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-19T21:02:40.606 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.406+0000 7fe06c796fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-19T21:02:40.606 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.604+0000 7fe06c796fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.606+0000 7fe06c796fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.631+0000 7fe06c796fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.637+0000 7fe06c796fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.640+0000 7fe06c796fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.643+0000 7fe06c796fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.644+0000 7fe06c796fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.645+0000 7fe06c796fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.648+0000 7fe06c796fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.676+0000 7fe06c796fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.688+0000 7fe06c796fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.697+0000 7fe06c796fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.701+0000 7fe06c796fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.704+0000 7fe06c796fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.705+0000 7fe06c796fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.706+0000 7fe06c796fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-19T21:02:40.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.828+0000 7fe06c796fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-19T21:02:40.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.831+0000 7fe06c796fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-19T21:02:40.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.839+0000 7fe06c796fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-19T21:02:40.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.841+0000 7fe06c796fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-19T21:02:40.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.842+0000 7fe06c796fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-19T21:02:40.907 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.845+0000 7fe06c796fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-19T21:02:41.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:40 trial175 ceph-mon[34116]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:41.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:40 trial175 ceph-mon[34116]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:41.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:40 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2467855699' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-19T21:02:41.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:40 trial175 ceph-mon[34116]: mgrmap e9: x(active, since 30s) 2026-02-19T21:02:41.284 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:40 trial090 ceph-mon[31759]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:41.284 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:40 trial090 ceph-mon[31759]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:41.284 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:40 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2467855699' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-19T21:02:41.284 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:40 trial090 ceph-mon[31759]: mgrmap e9: x(active, since 30s) 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.984+0000 7fe06c796fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:40.993+0000 7fe06c796fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.000+0000 7fe06c796fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.003+0000 7fe06c796fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.040+0000 7fe06c796fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.069+0000 7fe06c796fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.075+0000 7fe06c796fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.076+0000 7fe06c796fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-19T21:02:41.285 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:02:41.077+0000 7fe06c796fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:345: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: tz = given_cert.not_valid_after.tzinfo 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:346: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: if datetime.now(tz) >= given_cert.not_valid_after: 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:40 trial105 ceph-mon[33883]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:40 trial105 ceph-mon[33883]: from='mgr.14116 10.20.193.90:0/87152092' entity='mgr.x' 2026-02-19T21:02:41.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:40 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2467855699' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-19T21:02:41.287 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:40 trial105 ceph-mon[33883]: mgrmap e9: x(active, since 30s) 2026-02-19T21:02:41.906 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:02:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: Client ('10.20.193.90', 42862) lost — peer dropped the TLS connection suddenly, during handshake: (8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:998)') 2026-02-19T21:02:42.093 INFO:teuthology.orchestra.run.trial175.stdout:Scheduled mgr update... 2026-02-19T21:02:42.135 DEBUG:teuthology.orchestra.run.trial105:mgr.y> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.y.service 2026-02-19T21:02:42.138 DEBUG:teuthology.orchestra.run.trial175:mgr.z> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.z.service 2026-02-19T21:02:42.141 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-19T21:02:42.141 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-19T21:02:42.143 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-19T21:02:42.144 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-19T21:02:42.187 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-19T21:02:42.187 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: Active manager daemon x restarted 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: Activating manager daemon x 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: osdmap e4: 0 total, 0 up, 0 in 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: mgrmap e10: x(active, starting, since 0.00302505s) 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:42.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: Manager daemon x is now available 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.210 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.211 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.211 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.211 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.211 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-19T21:02:42.212 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-19T21:02:42.255 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-19T21:02:42.255 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-19T21:02:42.266 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.267 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-19T21:02:42.267 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-19T21:02:42.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: Active manager daemon x restarted 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: Activating manager daemon x 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: osdmap e4: 0 total, 0 up, 0 in 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: mgrmap e10: x(active, starting, since 0.00302505s) 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:42.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: Manager daemon x is now available 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.270 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.311 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-19T21:02:42.311 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-19T21:02:42.312 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.333 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.335 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-19T21:02:42.335 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-19T21:02:42.378 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-19T21:02:42.378 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-19T21:02:42.385 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.386 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-19T21:02:42.386 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-19T21:02:42.394 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: Active manager daemon x restarted 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: Activating manager daemon x 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: osdmap e4: 0 total, 0 up, 0 in 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: mgrmap e10: x(active, starting, since 0.00302505s) 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-19T21:02:42.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: Manager daemon x is now available 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:42.399 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.400 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-19T21:02:42.400 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-19T21:02:42.444 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-19T21:02:42.444 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-19T21:02:42.457 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.458 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-19T21:02:42.458 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-19T21:02:42.483 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.484 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-19T21:02:42.484 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-19T21:02:42.521 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.523 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-19T21:02:42.523 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-19T21:02:42.537 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.539 INFO:tasks.cephadm:setting config [mds] mds_use_global_snaprealm_seq_for_subvol = False 2026-02-19T21:02:42.539 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_use_global_snaprealm_seq_for_subvol False 2026-02-19T21:02:42.560 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.562 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-19T21:02:42.562 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-19T21:02:42.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 -- 10.20.193.90:0/2566111545 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbce003f870 msgr2=0x7fbce005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 --2- 10.20.193.90:0/2566111545 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbce003f870 0x7fbce005fd20 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcfc004750 tx=0x7fbcfc009390 comp rx=0 tx=0).stop 2026-02-19T21:02:42.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 -- 10.20.193.90:0/2566111545 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbd0810dd80 msgr2=0x7fbd0816f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 --2- 10.20.193.90:0/2566111545 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbd0810dd80 0x7fbd0816f0c0 secure :-1 s=READY pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcf002f680 tx=0x7fbcf00046d0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 -- 10.20.193.90:0/2566111545 shutdown_connections 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 --2- 10.20.193.90:0/2566111545 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbce003f870 0x7fbce005fd20 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 --2- 10.20.193.90:0/2566111545 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbd0810e730 0x7fbd080f3910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 --2- 10.20.193.90:0/2566111545 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbd0810dd80 0x7fbd0816f0c0 unknown :-1 s=CLOSED pgs=6 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 --2- 10.20.193.90:0/2566111545 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbd0810cc00 0x7fbd080f30b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 -- 10.20.193.90:0/2566111545 >> 10.20.193.90:0/2566111545 conn(0x7fbd080ea320 msgr2=0x7fbd08060620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 -- 10.20.193.90:0/2566111545 shutdown_connections 2026-02-19T21:02:42.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.579+0000 7fbd0caa86c0 1 -- 10.20.193.90:0/2566111545 wait complete. 2026-02-19T21:02:42.583 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-19T21:02:42.583 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-19T21:02:42.591 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-19T21:02:42.591 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-19T21:02:42.615 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.618 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-19T21:02:42.618 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-19T21:02:42.620 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.621 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-19T21:02:42.622 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-19T21:02:42.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.619+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/3616157058 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd01153f0 msgr2=0x7f8fd0175d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.619+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/3616157058 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175d90 secure :-1 s=READY pgs=5 gs=2 cs=0 l=1 c_cookie=14909249573863748298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fcc006fd0 tx=0x7f8fcc02fd20 comp rx=0 tx=0).stop 2026-02-19T21:02:42.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.619+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/3616157058 shutdown_connections 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/3616157058 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175d90 unknown :-1 s=CLOSED pgs=5 gs=2 cs=0 l=1 c_cookie=14909249573863748298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/3616157058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd010fbd0 0x7f8fd0114c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/3616157058 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd010f1e0 0x7f8fd010f5b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/3616157058 >> 10.20.193.90:0/3616157058 conn(0x7f8fd00ecac0 msgr2=0x7f8fd010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/3616157058 shutdown_connections 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/3616157058 wait complete. 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 Processor -- start 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.620+0000 7f8fd87eb6c0 1 -- start start 2026-02-19T21:02:42.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd87eb6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 0x7f8fd00fe450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd87eb6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd87eb6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd00fe990 0x7f8fd01032f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd655c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 0x7f8fd00fe450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd655c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 0x7f8fd00fe450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44214/0 (socket says 10.20.193.90:44214) 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd5d5b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd5d5b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:46666/0 (socket says 10.20.193.90:46666) 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd655c6c0 1 -- 10.20.193.90:0/1350114819 learned_addr learned my addr 10.20.193.90:0/1350114819 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.621+0000 7f8fd6d5d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd00fe990 0x7f8fd01032f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd00ff080 con 0x7f8fd00fe990 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd0103830 con 0x7f8fd010f1e0 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd01039f0 con 0x7f8fd01153f0 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd655c6c0 1 -- 10.20.193.90:0/1350114819 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 msgr2=0x7f8fd0175c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd655c6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd655c6c0 1 -- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd00fe990 msgr2=0x7f8fd01032f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd655c6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd00fe990 0x7f8fd01032f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd655c6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc00a5b0 con 0x7f8fd010f1e0 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd6d5d6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd00fe990 0x7f8fd01032f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd5d5b6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:02:42.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fd655c6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 0x7f8fd00fe450 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc000b800 tx=0x7f8fc000bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.628 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2026-02-19T21:02:42.629 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr debug_cephsqlite 20 2026-02-19T21:02:42.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.622+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fc0004a80 con 0x7f8fd010f1e0 2026-02-19T21:02:42.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.623+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(25 keys) ==== 1050+0+0 (secure 0 0 0) 0x7f8fc0009030 con 0x7f8fd010f1e0 2026-02-19T21:02:42.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.623+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8fc0005550 con 0x7f8fd010f1e0 2026-02-19T21:02:42.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.623+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd0103cd0 con 0x7f8fd010f1e0 2026-02-19T21:02:42.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.623+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd0104160 con 0x7f8fd010f1e0 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.623+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f8fc0004060 con 0x7f8fd010f1e0 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.624+0000 7f8fb77fe6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8fa803f820 0x7f8fa805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.624+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8fc0004c70 con 0x7f8fd010f1e0 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.624+0000 7f8fd5d5b6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8fa803f820 0x7f8fa805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.624+0000 7f8fd5d5b6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8fa803f820 0x7f8fa805fcd0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd005e990 tx=0x7f8fc4009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.624+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f98005100 con 0x7f8fd010f1e0 2026-02-19T21:02:42.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.628+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8fc00071c0 con 0x7f8fd010f1e0 2026-02-19T21:02:42.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.628+0000 7fe8723096c0 1 -- 10.20.193.90:0/2651829951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 msgr2=0x7fe86c10f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.628+0000 7fe8723096c0 1 --2- 10.20.193.90:0/2651829951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10f5e0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=12904304115704395868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8580099a0 tx=0x7fe85802ed50 comp rx=0 tx=0).stop 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.628+0000 7fe8723096c0 1 -- 10.20.193.90:0/2651829951 shutdown_connections 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.628+0000 7fe8723096c0 1 --2- 10.20.193.90:0/2651829951 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe86c115420 0x7fe86c175dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.629+0000 7fe8723096c0 1 --2- 10.20.193.90:0/2651829951 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10fc00 0x7fe86c114c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.629+0000 7fe8723096c0 1 --2- 10.20.193.90:0/2651829951 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10f5e0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=12904304115704395868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.629+0000 7fe8723096c0 1 -- 10.20.193.90:0/2651829951 >> 10.20.193.90:0/2651829951 conn(0x7fe86c0ecab0 msgr2=0x7fe86c10cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.629+0000 7fe8723096c0 1 -- 10.20.193.90:0/2651829951 shutdown_connections 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.629+0000 7fe8723096c0 1 -- 10.20.193.90:0/2651829951 wait complete. 2026-02-19T21:02:42.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.629+0000 7fe8723096c0 1 Processor -- start 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 -- start start 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10cba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe86c115420 0x7fe86c175cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 0x7fe86c10ae80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c10b610 con 0x7fe86c10f210 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c10b780 con 0x7fe86c10d1d0 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.630+0000 7fe8723096c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c10b940 con 0x7fe86c115420 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 0x7fe86c10ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 0x7fe86c10ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44232/0 (socket says 10.20.193.90:44232) 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe86b7fe6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe86c115420 0x7fe86c175cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 -- 10.20.193.90:0/1036840245 learned_addr learned my addr 10.20.193.90:0/1036840245 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.635 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-19T21:02:42.636 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-19T21:02:42.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 -- 10.20.193.90:0/1036840245 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe86c115420 msgr2=0x7fe86c175cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe86c115420 0x7fe86c175cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe86bfff6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 -- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 msgr2=0x7fe86c10cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 -- 10.20.193.90:0/1036840245 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe858009590 con 0x7fe86c10d1d0 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe86bfff6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10cba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.631+0000 7fe87087b6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 0x7fe86c10ae80 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe860006a60 tx=0x7fe86000cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.632+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe860003c40 con 0x7fe86c10d1d0 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.632+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c10bc20 con 0x7fe86c10d1d0 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.632+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(25 keys) ==== 1050+0+0 (secure 0 0 0) 0x7fe86000a070 con 0x7fe86c10d1d0 2026-02-19T21:02:42.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.632+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe86000dc10 con 0x7fe86c10d1d0 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.632+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c0f11b0 con 0x7fe86c10d1d0 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.633+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c1104e0 con 0x7fe86c10d1d0 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.634+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fe8600081c0 con 0x7fe86c10d1d0 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.634+0000 7fe8697fa6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe84003f870 0x7fe84005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.634+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe860052660 con 0x7fe86c10d1d0 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.634+0000 7fe86bfff6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe84003f870 0x7fe84005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.635+0000 7fe86bfff6c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe84003f870 0x7fe84005fd20 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8580098c0 tx=0x7fe8580023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.640 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.636+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe860009050 con 0x7fe86c10d1d0 2026-02-19T21:02:42.656 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-19T21:02:42.657 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-19T21:02:42.663 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.666 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-19T21:02:42.666 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-19T21:02:42.668 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.665+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb5b4172220 con 0x7fb5b410cc00 2026-02-19T21:02:42.670 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2026-02-19T21:02:42.671 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2026-02-19T21:02:42.672 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.669+0000 7fb5a9ffb6c0 1 -- 10.20.193.90:0/3260520321 <== mon.0 v2:10.20.193.90:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fb5a40123b0 con 0x7fb5b410cc00 2026-02-19T21:02:42.672 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.668+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 7 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f8fc00071c0 con 0x7f8fd010f1e0 2026-02-19T21:02:42.672 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.669+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 7 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fe860009050 con 0x7fe86c10d1d0 2026-02-19T21:02:42.673 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.669+0000 7fb5a9ffb6c0 1 -- 10.20.193.90:0/3260520321 <== mon.0 v2:10.20.193.90:3300/0 10 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7fb5a40123b0 con 0x7fb5b410cc00 2026-02-19T21:02:42.673 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.670+0000 7f2d457fa6c0 1 -- 10.20.193.90:0/1668589157 <== mon.0 v2:10.20.193.90:3300/0 9 ==== config(26 keys) ==== 1081+0+0 (secure 0 0 0) 0x7f2d3c034e10 con 0x7f2d481109a0 2026-02-19T21:02:42.676 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb59003f820 msgr2=0x7fb59005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.676 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 --2- 10.20.193.90:0/3260520321 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb59003f820 0x7fb59005fcd0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb59c02fc20 tx=0x7fb59c0023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.676 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5b410cc00 msgr2=0x7fb5b40f87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.676 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 --2- 10.20.193.90:0/3260520321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5b410cc00 0x7fb5b40f87d0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5a400b710 tx=0x7fb5a400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.676 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 shutdown_connections 2026-02-19T21:02:42.677 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2026-02-19T21:02:42.677 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2026-02-19T21:02:42.678 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 --2- 10.20.193.90:0/3260520321 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb59003f820 0x7fb59005fcd0 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 --2- 10.20.193.90:0/3260520321 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5b410e730 0x7fb5b40f9030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 --2- 10.20.193.90:0/3260520321 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5b410dd80 0x7fb5b416f0c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 --2- 10.20.193.90:0/3260520321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5b410cc00 0x7fb5b40f87d0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 >> 10.20.193.90:0/3260520321 conn(0x7fb5b40ea320 msgr2=0x7fb5b40605a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.674+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 shutdown_connections 2026-02-19T21:02:42.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.675+0000 7fb5bae2d6c0 1 -- 10.20.193.90:0/3260520321 wait complete. 2026-02-19T21:02:42.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.675+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f2d48063120 con 0x7f2d481109a0 2026-02-19T21:02:42.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.677+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 8 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8fc00254f0 con 0x7f8fd010f1e0 2026-02-19T21:02:42.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.677+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 8 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe860012030 con 0x7fe86c10d1d0 2026-02-19T21:02:42.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.679+0000 7f2d457fa6c0 1 -- 10.20.193.90:0/1668589157 <== mon.0 v2:10.20.193.90:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f2d3c039480 con 0x7f2d481109a0 2026-02-19T21:02:42.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.679+0000 7f2d457fa6c0 1 -- 10.20.193.90:0/1668589157 <== mon.0 v2:10.20.193.90:3300/0 11 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2d3c0396a0 con 0x7f2d481109a0 2026-02-19T21:02:42.683 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2026-02-19T21:02:42.684 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/log_level debug 2026-02-19T21:02:42.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d1c03f820 msgr2=0x7f2d1c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 --2- 10.20.193.90:0/1668589157 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d1c03f820 0x7f2d1c05fcd0 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d34004750 tx=0x7f2d34009310 comp rx=0 tx=0).stop 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d481109a0 msgr2=0x7f2d4811b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 --2- 10.20.193.90:0/1668589157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d481109a0 0x7f2d4811b4b0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d3c030810 tx=0x7f2d3c005570 comp rx=0 tx=0).stop 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 shutdown_connections 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 --2- 10.20.193.90:0/1668589157 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d1c03f820 0x7f2d1c05fcd0 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 --2- 10.20.193.90:0/1668589157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d481109a0 0x7f2d4811b4b0 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 --2- 10.20.193.90:0/1668589157 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d4810fff0 0x7f2d4811a8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 --2- 10.20.193.90:0/1668589157 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d4810ee70 0x7f2d4811a270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.686+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 >> 10.20.193.90:0/1668589157 conn(0x7f2d480ec5b0 msgr2=0x7f2d4810c990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.697 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-19T21:02:42.697 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-19T21:02:42.698 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.687+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 shutdown_connections 2026-02-19T21:02:42.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.687+0000 7f2d4e90c6c0 1 -- 10.20.193.90:0/1668589157 wait complete. 2026-02-19T21:02:42.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.706+0000 7f648f3446c0 1 -- 10.20.193.90:0/70428363 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800c4030 msgr2=0x7f64800c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.706+0000 7f648f3446c0 1 --2- 10.20.193.90:0/70428363 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800c4030 0x7f64800c4400 secure :-1 s=READY pgs=8 gs=3 cs=0 l=1 c_cookie=12383103094976320007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c0098a0 tx=0x7f647c02ec70 comp rx=0 tx=0).stop 2026-02-19T21:02:42.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 -- 10.20.193.90:0/70428363 shutdown_connections 2026-02-19T21:02:42.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 --2- 10.20.193.90:0/70428363 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f64800ca010 0x7f64800ca900 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 --2- 10.20.193.90:0/70428363 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4a20 0x7f64800c9860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 --2- 10.20.193.90:0/70428363 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800c4030 0x7f64800c4400 unknown :-1 s=CLOSED pgs=8 gs=3 cs=0 l=1 c_cookie=12383103094976320007 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 -- 10.20.193.90:0/70428363 >> 10.20.193.90:0/70428363 conn(0x7f648001c640 msgr2=0x7f648001ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 -- 10.20.193.90:0/70428363 shutdown_connections 2026-02-19T21:02:42.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.707+0000 7f648f3446c0 1 -- 10.20.193.90:0/70428363 wait complete. 2026-02-19T21:02:42.712 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-19T21:02:42.713 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 Processor -- start 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 -- start start 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 0x7f64800dd910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f64800ca010 0x7f64800dde50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800e3210 0x7f64800e36b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64800e3c20 con 0x7f64800c4030 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64800e3d90 con 0x7f64800e3210 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648f3446c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64800e3f50 con 0x7f64800ca010 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648e3426c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 0x7f64800dd910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648e3426c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 0x7f64800dd910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38324/0 (socket says 10.20.193.90:38324) 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f648e3426c0 1 -- 10.20.193.90:0/2444388618 learned_addr learned my addr 10.20.193.90:0/2444388618 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648e3426c0 1 -- 10.20.193.90:0/2444388618 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f64800ca010 msgr2=0x7f64800dde50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648e3426c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f64800ca010 0x7f64800dde50 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648e3426c0 1 -- 10.20.193.90:0/2444388618 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800e3210 msgr2=0x7f64800e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648eb436c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800e3210 0x7f64800e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648e3426c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800e3210 0x7f64800e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648e3426c0 1 -- 10.20.193.90:0/2444388618 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648400a660 con 0x7f64800c4030 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648eb436c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800e3210 0x7f64800e36b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:02:42.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f648e3426c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 0x7f64800dd910 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c0097f0 tx=0x7f647c005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f0f767436c0 1 -- 10.20.193.90:0/848193708 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 msgr2=0x7f0f680b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.708+0000 7f0f767436c0 1 --2- 10.20.193.90:0/848193708 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 0x7f0f680b71d0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=1151905730986918119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f6c00aa40 tx=0x7f0f6c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 -- 10.20.193.90:0/848193708 shutdown_connections 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 --2- 10.20.193.90:0/848193708 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680bd010 0x7f0f6811d9b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 --2- 10.20.193.90:0/848193708 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f680b77f0 0x7f0f680bc830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 --2- 10.20.193.90:0/848193708 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 0x7f0f680b71d0 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=1151905730986918119 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 -- 10.20.193.90:0/848193708 >> 10.20.193.90:0/848193708 conn(0x7f0f68094680 msgr2=0x7f0f680b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 -- 10.20.193.90:0/848193708 shutdown_connections 2026-02-19T21:02:42.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.709+0000 7f0f767436c0 1 -- 10.20.193.90:0/848193708 wait complete. 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 Processor -- start 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 -- start start 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 0x7f0f680c2f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f680bd010 0x7f0f680c3450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 0x7f0f680c8cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f680c9220 con 0x7f0f680bd010 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f680c9390 con 0x7f0f680b6e00 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f0f767436c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f680c9550 con 0x7f0f680c8810 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 0x7f0f680c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 0x7f0f680c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:46724/0 (socket says 10.20.193.90:46724) 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 -- 10.20.193.90:0/3089510477 learned_addr learned my addr 10.20.193.90:0/3089510477 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f757416c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 0x7f0f680c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 -- 10.20.193.90:0/3089510477 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 msgr2=0x7f0f680c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 0x7f0f680c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 -- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f680bd010 msgr2=0x7f0f680c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f680bd010 0x7f0f680c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 -- 10.20.193.90:0/3089510477 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c00a660 con 0x7f0f680c8810 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f0f75f426c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 0x7f0f680c8cb0 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f64005dc0 tx=0x7f0f6400bb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647c002ae0 con 0x7f64800c4030 2026-02-19T21:02:42.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c0094c0 con 0x7f64800c4030 2026-02-19T21:02:42.719 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f647c002c40 con 0x7f64800c4030 2026-02-19T21:02:42.719 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6480124710 con 0x7f64800c4030 2026-02-19T21:02:42.719 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.710+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f647c031030 con 0x7f64800c4030 2026-02-19T21:02:42.719 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.711+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64800c5050 con 0x7f64800c4030 2026-02-19T21:02:42.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.712+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f64004250 con 0x7f0f680c8810 2026-02-19T21:02:42.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.712+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6811ae10 con 0x7f0f680c8810 2026-02-19T21:02:42.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.712+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0f64009070 con 0x7f0f680c8810 2026-02-19T21:02:42.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.712+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6811b2f0 con 0x7f0f680c8810 2026-02-19T21:02:42.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.715+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f647c0071c0 con 0x7f64800c4030 2026-02-19T21:02:42.721 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.713+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f64004250 con 0x7f0f680c8810 2026-02-19T21:02:42.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.716+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f0f6400cb30 con 0x7f0f680c8810 2026-02-19T21:02:42.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.717+0000 7f646f7fe6c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f646003f820 0x7f646005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.717+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f680b80d0 con 0x7f0f680c8810 2026-02-19T21:02:42.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.717+0000 7f0f5e7fc6c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f4c03f880 0x7f0f4c05fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.718+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f0f64051c70 con 0x7f0f680c8810 2026-02-19T21:02:42.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.717+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f647c0752b0 con 0x7f64800c4030 2026-02-19T21:02:42.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.718+0000 7f0f757416c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f4c03f880 0x7f0f4c05fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.718+0000 7f648db416c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f646003f820 0x7f646005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.719+0000 7f0f757416c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f4c03f880 0x7f0f4c05fd30 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f6c00a990 tx=0x7f0f6c002470 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.724 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-19T21:02:42.725 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-19T21:02:42.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.721+0000 7f648db416c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f646003f820 0x7f646005fcd0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6484005830 tx=0x7f6484006f90 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.720+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0f6400fa50 con 0x7f0f680c8810 2026-02-19T21:02:42.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.722+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f647c002db0 con 0x7f64800c4030 2026-02-19T21:02:42.758 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.761 DEBUG:tasks.cephadm:set 31 configs 2026-02-19T21:02:42.761 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.761 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.761 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.762 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.769+0000 7f9a36e806c0 1 -- 10.20.193.90:0/1783335783 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30114690 msgr2=0x7f9a3015ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.769+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/1783335783 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30114690 0x7f9a3015ba70 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=10703424936039730906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a180098a0 tx=0x7f9a1802ec40 comp rx=0 tx=0).stop 2026-02-19T21:02:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 -- 10.20.193.90:0/1783335783 shutdown_connections 2026-02-19T21:02:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/1783335783 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 0x7f9a3017c390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/1783335783 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30114690 0x7f9a3015ba70 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=10703424936039730906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/1783335783 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30113d80 0x7f9a30114150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 -- 10.20.193.90:0/1783335783 >> 10.20.193.90:0/1783335783 conn(0x7f9a300586b0 msgr2=0x7f9a30058ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 -- 10.20.193.90:0/1783335783 shutdown_connections 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 -- 10.20.193.90:0/1783335783 wait complete. 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.772+0000 7f9a36e806c0 1 Processor -- start 2026-02-19T21:02:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.773+0000 7f9a36e806c0 1 -- start start 2026-02-19T21:02:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.773+0000 7f9a36e806c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 0x7f9a300ff0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.773+0000 7f9a36e806c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30114690 0x7f9a300ff5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.773+0000 7f9a36e806c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 0x7f9a301049b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.774+0000 7f9a34bf56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 0x7f9a300ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.774+0000 7f9a34bf56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 0x7f9a300ff0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:46748/0 (socket says 10.20.193.90:46748) 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.774+0000 7f9a2ffff6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30114690 0x7f9a300ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.774+0000 7f9a2ffff6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30114690 0x7f9a300ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44272/0 (socket says 10.20.193.90:44272) 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.774+0000 7f9a34bf56c0 1 -- 10.20.193.90:0/3401589010 learned_addr learned my addr 10.20.193.90:0/3401589010 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.775+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30105000 con 0x7f9a3015bfb0 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.775+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30105170 con 0x7f9a30114690 2026-02-19T21:02:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.775+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30105330 con 0x7f9a30113d80 2026-02-19T21:02:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.774+0000 7f9a353f66c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 0x7f9a301049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.775+0000 7f9a34bf56c0 1 -- 10.20.193.90:0/3401589010 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30114690 msgr2=0x7f9a300ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.775+0000 7f9a34bf56c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30114690 0x7f9a300ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.775+0000 7f9a34bf56c0 1 -- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 msgr2=0x7f9a301049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.776+0000 7f9a34bf56c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 0x7f9a301049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.776+0000 7f9a34bf56c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a240094c0 con 0x7f9a30113d80 2026-02-19T21:02:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.777+0000 7f9a353f66c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 0x7f9a301049b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.778+0000 7f9a34bf56c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 0x7f9a300ff0b0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a2400ba30 tx=0x7f9a2400bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.778+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a240044a0 con 0x7f9a30113d80 2026-02-19T21:02:42.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.778+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9a24009030 con 0x7f9a30113d80 2026-02-19T21:02:42.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.778+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a240071c0 con 0x7f9a30113d80 2026-02-19T21:02:42.780 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.779+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a180094c0 con 0x7f9a30113d80 2026-02-19T21:02:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.779+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a30157a30 con 0x7f9a30113d80 2026-02-19T21:02:42.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.781+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3005aff0 con 0x7f9a30113d80 2026-02-19T21:02:42.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.781+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f9a24004880 con 0x7f9a30113d80 2026-02-19T21:02:42.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.781+0000 7f9a2dffb6c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a0803f820 0x7f9a0805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.781+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f9a240512d0 con 0x7f9a30113d80 2026-02-19T21:02:42.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.782+0000 7f9a2ffff6c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a0803f820 0x7f9a0805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.783+0000 7f9a2ffff6c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a0803f820 0x7f9a0805fcd0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a180092a0 tx=0x7f9a18005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.785+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9a24005210 con 0x7f9a30113d80 2026-02-19T21:02:42.799 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.810 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.819 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.821 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.819+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fe86c10c120 con 0x7fe86c10d1d0 2026-02-19T21:02:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.821+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f8f980053b0 con 0x7f8fd010f1e0 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.821+0000 7f59abd836c0 1 -- 10.20.193.90:0/527944130 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 msgr2=0x7f59a4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.821+0000 7f59abd836c0 1 --2- 10.20.193.90:0/527944130 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4175db0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=146454086989926050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a000aa40 tx=0x7f59a0041250 comp rx=0 tx=0).stop 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.821+0000 7f59abd836c0 1 -- 10.20.193.90:0/527944130 shutdown_connections 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.821+0000 7f59abd836c0 1 --2- 10.20.193.90:0/527944130 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4175db0 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=146454086989926050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.822+0000 7f59abd836c0 1 --2- 10.20.193.90:0/527944130 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410fbf0 0x7f59a4114c30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.822+0000 7f59abd836c0 1 --2- 10.20.193.90:0/527944130 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a410f200 0x7f59a410f5d0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.822+0000 7f59abd836c0 1 -- 10.20.193.90:0/527944130 >> 10.20.193.90:0/527944130 conn(0x7f59a40ecac0 msgr2=0x7f59a410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.822+0000 7f59abd836c0 1 -- 10.20.193.90:0/527944130 shutdown_connections 2026-02-19T21:02:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.823+0000 7f59abd836c0 1 -- 10.20.193.90:0/527944130 wait complete. 2026-02-19T21:02:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.824+0000 7f59abd836c0 1 Processor -- start 2026-02-19T21:02:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.824+0000 7f59abd836c0 1 -- start start 2026-02-19T21:02:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.824+0000 7f59abd836c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410f200 0x7f59a4118530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59abd836c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4118a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59abd836c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a411de30 0x7f59a411e2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59a9af46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410f200 0x7f59a4118530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59a92f36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4118a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59a92f36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4118a70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44286/0 (socket says 10.20.193.90:44286) 2026-02-19T21:02:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59abd836c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59a411e840 con 0x7f59a410f200 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59a9af46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410f200 0x7f59a4118530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38360/0 (socket says 10.20.193.90:38360) 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.825+0000 7f59a9af46c0 1 -- 10.20.193.90:0/1409957387 learned_addr learned my addr 10.20.193.90:0/1409957387 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59a411e9b0 con 0x7f59a4115410 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59a411eb70 con 0x7f59a411de30 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59aa2f56c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a411de30 0x7f59a411e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59aa2f56c0 1 -- 10.20.193.90:0/1409957387 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 msgr2=0x7f59a4118a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59aa2f56c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4118a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59aa2f56c0 1 -- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410f200 msgr2=0x7f59a4118530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59aa2f56c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410f200 0x7f59a4118530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.826+0000 7f59aa2f56c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a000a660 con 0x7f59a411de30 2026-02-19T21:02:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.827+0000 7f59aa2f56c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a411de30 0x7f59a411e2d0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a0041760 tx=0x7f59a00081c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.828+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59a0005b00 con 0x7f59a411de30 2026-02-19T21:02:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.828+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a415efc0 con 0x7f59a411de30 2026-02-19T21:02:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.828+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f59a0003cd0 con 0x7f59a411de30 2026-02-19T21:02:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.828+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f59a00062b0 con 0x7f59a411de30 2026-02-19T21:02:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.828+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a415f3f0 con 0x7f59a411de30 2026-02-19T21:02:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.829+0000 7fe8697fa6c0 1 -- 10.20.193.90:0/1036840245 <== mon.2 v2:10.20.193.105:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7fe860004030 con 0x7fe86c10d1d0 2026-02-19T21:02:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.830+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a41104d0 con 0x7f59a411de30 2026-02-19T21:02:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.830+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/3327674106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 msgr2=0x7f4dec10d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.831+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/3327674106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec10d340 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=13723304302824346519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4de0009970 tx=0x7f4de002ed50 comp rx=0 tx=0).stop 2026-02-19T21:02:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.831+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/3327674106 shutdown_connections 2026-02-19T21:02:42.832 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.831+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/3327674106 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 0x7f4dec173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/3327674106 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec10d960 0x7f4dec1129a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/3327674106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec10d340 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=13723304302824346519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/3327674106 >> 10.20.193.90:0/3327674106 conn(0x7f4dec0ea870 msgr2=0x7f4dec10ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/3327674106 shutdown_connections 2026-02-19T21:02:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/3327674106 wait complete. 2026-02-19T21:02:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.830+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f59a0003810 con 0x7f59a411de30 2026-02-19T21:02:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.830+0000 7f5992ffd6c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f598003f820 0x7f598005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.830+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f59a0087990 con 0x7f59a411de30 2026-02-19T21:02:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.831+0000 7f59a9af46c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f598003f820 0x7f598005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.831+0000 7f59a9af46c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f598003f820 0x7f598005fcd0 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5994006f40 tx=0x7f5994009210 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f8fb77fe6c0 1 -- 10.20.193.90:0/1350114819 <== mon.2 v2:10.20.193.105:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f8fc000ee20 con 0x7f8fd010f1e0 2026-02-19T21:02:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.832+0000 7f4df11cf6c0 1 Processor -- start 2026-02-19T21:02:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 -- start start 2026-02-19T21:02:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec11af80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f59a0005c60 con 0x7f59a411de30 2026-02-19T21:02:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 0x7f4dec11b4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 0x7f4dec120d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec121260 con 0x7f4dec120880 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec1213d0 con 0x7f4dec10cf70 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4df11cf6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec121590 con 0x7f4dec113180 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4dea5756c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 0x7f4dec11b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4deb5776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 0x7f4dec120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.833+0000 7f4dead766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec11af80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec11af80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44314/0 (socket says 10.20.193.90:44314) 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 -- 10.20.193.90:0/2103152243 learned_addr learned my addr 10.20.193.90:0/2103152243 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dea5756c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 0x7f4dec11b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:46786/0 (socket says 10.20.193.90:46786) 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4deb5776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 0x7f4dec120d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38380/0 (socket says 10.20.193.90:38380) 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 -- 10.20.193.90:0/2103152243 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 msgr2=0x7f4dec11b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 0x7f4dec11b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 -- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 msgr2=0x7f4dec120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 0x7f4dec120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe84003f870 msgr2=0x7fe84005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4dead766c0 1 -- 10.20.193.90:0/2103152243 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0009590 con 0x7f4dec10cf70 2026-02-19T21:02:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.834+0000 7f4deb5776c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 0x7f4dec120d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe84003f870 0x7fe84005fd20 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8580098c0 tx=0x7fe8580023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 msgr2=0x7fe86c10ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 0x7fe86c10ae80 secure :-1 s=READY pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe860006a60 tx=0x7fe86000cca0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7f4dead766c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec11af80 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4de00098c0 tx=0x7f4de002fc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4de0002ae0 con 0x7f4dec10cf70 2026-02-19T21:02:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec161a10 con 0x7f4dec10cf70 2026-02-19T21:02:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec161ee0 con 0x7f4dec10cf70 2026-02-19T21:02:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 shutdown_connections 2026-02-19T21:02:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe84003f870 0x7fe84005fd20 unknown :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe86c10d1d0 0x7fe86c10ae80 unknown :-1 s=CLOSED pgs=7 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe86c115420 0x7fe86c175cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 --2- 10.20.193.90:0/1036840245 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe86c10f210 0x7fe86c10cba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 >> 10.20.193.90:0/1036840245 conn(0x7fe86c0ecab0 msgr2=0x7fe86c064fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4de0002c40 con 0x7f4dec10cf70 2026-02-19T21:02:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4de00372f0 con 0x7f4dec10cf70 2026-02-19T21:02:42.843 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 shutdown_connections 2026-02-19T21:02:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.835+0000 7fe8723096c0 1 -- 10.20.193.90:0/1036840245 wait complete. 2026-02-19T21:02:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8fa803f820 msgr2=0x7f8fa805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8fa803f820 0x7f8fa805fcd0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fd005e990 tx=0x7f8fc4009260 comp rx=0 tx=0).stop 2026-02-19T21:02:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 msgr2=0x7f8fd00fe450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 0x7f8fd00fe450 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8fc000b800 tx=0x7f8fc000bcd0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 shutdown_connections 2026-02-19T21:02:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f4de0037480 con 0x7f4dec10cf70 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8fa803f820 0x7f8fa805fcd0 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8fd00fe990 0x7f8fd01032f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8fd01153f0 0x7f8fd0175c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 --2- 10.20.193.90:0/1350114819 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8fd010f1e0 0x7f8fd00fe450 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 >> 10.20.193.90:0/1350114819 conn(0x7f8fd00ecac0 msgr2=0x7f8fd010de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.837+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 shutdown_connections 2026-02-19T21:02:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.837+0000 7f8fd87eb6c0 1 -- 10.20.193.90:0/1350114819 wait complete. 2026-02-19T21:02:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.837+0000 7f4dcbfff6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4dc003f820 0x7f4dc005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.837+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4de0075180 con 0x7f4dec10cf70 2026-02-19T21:02:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.836+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec10e240 con 0x7f4dec10cf70 2026-02-19T21:02:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.837+0000 7f4dea5756c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4dc003f820 0x7f4dc005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.838+0000 7f4dea5756c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4dc003f820 0x7f4dc005fcd0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dec121910 tx=0x7f4dd4009310 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.840+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4de00313f0 con 0x7f4dec10cf70 2026-02-19T21:02:42.883 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.885+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f64800dea60 con 0x7f64800c4030 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/850144571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a01198b0 msgr2=0x7fa7a017a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/850144571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a01198b0 0x7fa7a017a280 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=4166361284727082692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa798009bd0 tx=0x7fa79802ef90 comp rx=0 tx=0).stop 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/850144571 shutdown_connections 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/850144571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a01198b0 0x7fa7a017a280 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=4166361284727082692 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/850144571 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0114150 0x7fa7a0119100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/850144571 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa7a0113760 0x7fa7a0113b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.891 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/850144571 >> 10.20.193.90:0/850144571 conn(0x7fa7a0060720 msgr2=0x7fa7a0060cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/850144571 shutdown_connections 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.888+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/850144571 wait complete. 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 Processor -- start 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 -- start start 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 0x7fa7a0121740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa7a01198b0 0x7fa7a0121c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0126ff0 0x7fa7a0127490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a01279d0 con 0x7fa7a0113760 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0127b40 con 0x7fa7a01198b0 2026-02-19T21:02:42.892 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a88e86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0127d00 con 0x7fa7a0126ff0 2026-02-19T21:02:42.893 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a66596c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 0x7fa7a0121740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.893 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a5e586c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa7a01198b0 0x7fa7a0121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.893 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a66596c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 0x7fa7a0121740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38392/0 (socket says 10.20.193.90:38392) 2026-02-19T21:02:42.893 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.889+0000 7fa7a66596c0 1 -- 10.20.193.90:0/1465368555 learned_addr learned my addr 10.20.193.90:0/1465368555 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.893 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a6e5a6c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0126ff0 0x7fa7a0127490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a66596c0 1 -- 10.20.193.90:0/1465368555 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0126ff0 msgr2=0x7fa7a0127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a66596c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0126ff0 0x7fa7a0127490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a66596c0 1 -- 10.20.193.90:0/1465368555 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa7a01198b0 msgr2=0x7fa7a0121c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a66596c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa7a01198b0 0x7fa7a0121c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a66596c0 1 -- 10.20.193.90:0/1465368555 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798009590 con 0x7fa7a0113760 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a6e5a6c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0126ff0 0x7fa7a0127490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:02:42.894 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7fa7a66596c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 0x7fa7a0121740 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa794006ea0 tx=0x7fa79400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.895 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.890+0000 7f646f7fe6c0 1 -- 10.20.193.90:0/2444388618 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f647c002db0 con 0x7f64800c4030 2026-02-19T21:02:42.895 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.892+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f0f680b71d0 con 0x7f0f680c8810 2026-02-19T21:02:42.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.891+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa794003c40 con 0x7fa7a0113760 2026-02-19T21:02:42.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.891+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a0168180 con 0x7fa7a0113760 2026-02-19T21:02:42.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.891+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a0168660 con 0x7fa7a0113760 2026-02-19T21:02:42.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.892+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa794003da0 con 0x7fa7a0113760 2026-02-19T21:02:42.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.893+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a01149a0 con 0x7fa7a0113760 2026-02-19T21:02:42.896 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.893+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa79400db50 con 0x7fa7a0113760 2026-02-19T21:02:42.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.893+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fa79400dcb0 con 0x7fa7a0113760 2026-02-19T21:02:42.897 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.894+0000 7fa78f7fe6c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa77c03f820 0x7fa77c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.894+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa7940524d0 con 0x7fa7a0113760 2026-02-19T21:02:42.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.894+0000 7fa7a5e586c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa77c03f820 0x7fa77c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.895+0000 7fa7a5e586c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa77c03f820 0x7fa77c05fcd0 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7a0128080 tx=0x7fa790005e60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.895+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f646003f820 msgr2=0x7f646005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.895+0000 7f648f3446c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f646003f820 0x7f646005fcd0 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6484005830 tx=0x7f6484006f90 comp rx=0 tx=0).stop 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.895+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 msgr2=0x7f64800dd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.895+0000 7f648f3446c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 0x7f64800dd910 secure :-1 s=READY pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f647c0097f0 tx=0x7f647c005540 comp rx=0 tx=0).stop 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 shutdown_connections 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f646003f820 0x7f646005fcd0 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f64800e3210 0x7f64800e36b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f64800ca010 0x7f64800dde50 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 --2- 10.20.193.90:0/2444388618 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f64800c4030 0x7f64800dd910 unknown :-1 s=CLOSED pgs=106 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.900 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 >> 10.20.193.90:0/2444388618 conn(0x7f648001c640 msgr2=0x7f64800c2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.900 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 shutdown_connections 2026-02-19T21:02:42.900 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.896+0000 7f648f3446c0 1 -- 10.20.193.90:0/2444388618 wait complete. 2026-02-19T21:02:42.900 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.898+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa79400e040 con 0x7fa7a0113760 2026-02-19T21:02:42.903 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.901+0000 7f0f5e7fc6c0 1 -- 10.20.193.90:0/3089510477 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7f0f6400f020 con 0x7f0f680c8810 2026-02-19T21:02:42.908 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f4c03f880 msgr2=0x7f0f4c05fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f4c03f880 0x7f0f4c05fd30 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f6c00a990 tx=0x7f0f6c002470 comp rx=0 tx=0).stop 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 msgr2=0x7f0f680c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 0x7f0f680c8cb0 secure :-1 s=READY pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f64005dc0 tx=0x7f0f6400bb60 comp rx=0 tx=0).stop 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 shutdown_connections 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f4c03f880 0x7f0f4c05fd30 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f680c8810 0x7f0f680c8cb0 unknown :-1 s=CLOSED pgs=7 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f680bd010 0x7f0f680c3450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 --2- 10.20.193.90:0/3089510477 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f680b6e00 0x7f0f680c2f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 >> 10.20.193.90:0/3089510477 conn(0x7f0f68094680 msgr2=0x7f0f680b4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.909 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 shutdown_connections 2026-02-19T21:02:42.910 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.907+0000 7f0f767436c0 1 -- 10.20.193.90:0/3089510477 wait complete. 2026-02-19T21:02:42.919 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.919 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.932 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.948 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.965 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 -- 10.20.193.90:0/419880788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 msgr2=0x7f04e81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/419880788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e81550e0 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=10109030614417559783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d8009970 tx=0x7f04d802ed70 comp rx=0 tx=0).stop 2026-02-19T21:02:42.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 -- 10.20.193.90:0/419880788 shutdown_connections 2026-02-19T21:02:42.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/419880788 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8155620 0x7f04e8175a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/419880788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e81550e0 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=10109030614417559783 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/419880788 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e8060760 0x7f04e8060b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.968+0000 7f04eddb56c0 1 -- 10.20.193.90:0/419880788 >> 10.20.193.90:0/419880788 conn(0x7f04e80ea870 msgr2=0x7f04e810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 -- 10.20.193.90:0/419880788 shutdown_connections 2026-02-19T21:02:42.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 -- 10.20.193.90:0/419880788 wait complete. 2026-02-19T21:02:42.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 Processor -- start 2026-02-19T21:02:42.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 -- start start 2026-02-19T21:02:42.972 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 0x7f04e8172800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e8172d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e8155620 0x7f04e8057230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.969+0000 7f04eddb56c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8057880 con 0x7f04e8061070 2026-02-19T21:02:42.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04eddb56c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04e80579f0 con 0x7f04e8060760 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04eddb56c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04e8057bb0 con 0x7f04e8155620 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 0x7f04e8172800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 0x7f04e8172800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44360/0 (socket says 10.20.193.90:44360) 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 -- 10.20.193.90:0/691957536 learned_addr learned my addr 10.20.193.90:0/691957536 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e6ffd6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e8172d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 -- 10.20.193.90:0/691957536 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e8155620 msgr2=0x7f04e8057230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e8155620 0x7f04e8057230 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 -- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 msgr2=0x7f04e8172d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e8172d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 -- 10.20.193.90:0/691957536 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8009590 con 0x7f04e8060760 2026-02-19T21:02:42.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e6ffd6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e8172d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.970+0000 7f04e77fe6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 0x7f04e8172800 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d4009490 tx=0x7f04d400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.971+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04d4004a80 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.971+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f04d4009030 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.971+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e8057e90 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.971+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e810cd20 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.971+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04d40079f0 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.972+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e8061c70 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.972+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f04d4007b80 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.972+0000 7f04e4ff96c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04bc03f870 0x7f04bc05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.972+0000 7f04e6ffd6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04bc03f870 0x7f04bc05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.972+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f04d4059c50 con 0x7f04e8060760 2026-02-19T21:02:42.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.973+0000 7f04e6ffd6c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04bc03f870 0x7f04bc05fd20 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04e810c010 tx=0x7f04d80023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.977 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.974+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f04d401ad90 con 0x7f04e8060760 2026-02-19T21:02:42.977 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.978 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.977+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f9a3005c250 con 0x7f9a30113d80 2026-02-19T21:02:42.982 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.981+0000 7f9a2dffb6c0 1 -- 10.20.193.90:0/3401589010 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7f9a2400fc90 con 0x7f9a30113d80 2026-02-19T21:02:42.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.983+0000 7f3053fff6c0 1 -- 10.20.193.90:0/1645053294 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f305802fd70 con 0x7f3064110c00 2026-02-19T21:02:42.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 -- 10.20.193.90:0/1645053294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 msgr2=0x7f3064110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 --2- 10.20.193.90:0/1645053294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f3064110fd0 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=17322989170242850956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3058009970 tx=0x7f305802ed70 comp rx=0 tx=0).stop 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 -- 10.20.193.90:0/1645053294 shutdown_connections 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 --2- 10.20.193.90:0/1645053294 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30641153e0 0x7f30640628a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 --2- 10.20.193.90:0/1645053294 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30641115f0 0x7f3064114c30 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 --2- 10.20.193.90:0/1645053294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f3064110fd0 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=17322989170242850956 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 -- 10.20.193.90:0/1645053294 >> 10.20.193.90:0/1645053294 conn(0x7f30640ecac0 msgr2=0x7f306410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 -- 10.20.193.90:0/1645053294 shutdown_connections 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.984+0000 7f306b6356c0 1 -- 10.20.193.90:0/1645053294 wait complete. 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.986+0000 7f306b6356c0 1 Processor -- start 2026-02-19T21:02:42.988 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.986+0000 7f306b6356c0 1 -- start start 2026-02-19T21:02:42.989 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f306b6356c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f30640f4790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.989 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f306b6356c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30641153e0 0x7f30640f4cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.989 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f30640f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f30640f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38422/0 (socket says 10.20.193.90:38422) 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 -- 10.20.193.90:0/3093284459 learned_addr learned my addr 10.20.193.90:0/3093284459 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30640fa090 0x7f30640fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30640faaa0 con 0x7f3064110c00 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30640fac10 con 0x7f30640fa090 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30640fadd0 con 0x7f30641153e0 2026-02-19T21:02:42.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a0803f820 msgr2=0x7f9a0805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a0803f820 0x7f9a0805fcd0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a180092a0 tx=0x7f9a18005910 comp rx=0 tx=0).stop 2026-02-19T21:02:42.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 msgr2=0x7f9a300ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 0x7f9a300ff0b0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a2400ba30 tx=0x7f9a2400bf00 comp rx=0 tx=0).stop 2026-02-19T21:02:42.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 shutdown_connections 2026-02-19T21:02:42.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 -- 10.20.193.90:0/3093284459 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30641153e0 msgr2=0x7f30640f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:42.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30641153e0 0x7f30640f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.992 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a0803f820 0x7f9a0805fcd0 unknown :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.992 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9a3015bfb0 0x7f9a301049b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.992 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9a30114690 0x7f9a300ff5f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.992 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 --2- 10.20.193.90:0/3401589010 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9a30113d80 0x7f9a300ff0b0 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.992 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 >> 10.20.193.90:0/3401589010 conn(0x7f9a300586b0 msgr2=0x7f9a300f7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:42.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 -- 10.20.193.90:0/3093284459 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30640fa090 msgr2=0x7f30640fa530 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-19T21:02:42.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30640fa090 0x7f30640fa530 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:42.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.987+0000 7f30693a66c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3058009590 con 0x7f3064110c00 2026-02-19T21:02:42.993 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f30693a66c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f30640f4790 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30580092b0 tx=0x7f305802fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.993 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:42.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 shutdown_connections 2026-02-19T21:02:42.994 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f9a36e806c0 1 -- 10.20.193.90:0/3401589010 wait complete. 2026-02-19T21:02:42.995 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial090') 2026-02-19T21:02:42.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3058002ba0 con 0x7f3064110c00 2026-02-19T21:02:42.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3064175cb0 con 0x7f3064110c00 2026-02-19T21:02:42.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.988+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3064176130 con 0x7f3064110c00 2026-02-19T21:02:42.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.989+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30641104d0 con 0x7f3064110c00 2026-02-19T21:02:42.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.989+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3058007680 con 0x7f3064110c00 2026-02-19T21:02:42.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.989+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3058002ba0 con 0x7f3064110c00 2026-02-19T21:02:42.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.990+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f3058002d00 con 0x7f3064110c00 2026-02-19T21:02:42.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.990+0000 7f30527fc6c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f304003f880 0x7f304005fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:42.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.990+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f30580750e0 con 0x7f3064110c00 2026-02-19T21:02:42.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.991+0000 7f3068ba56c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f304003f880 0x7f304005fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:42.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.992+0000 7f3068ba56c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f304003f880 0x7f304005fd30 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30640fb120 tx=0x7f3054006cd0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:42.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.993+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3058039260 con 0x7f3064110c00 2026-02-19T21:02:42.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f59a41196d0 con 0x7f59a411de30 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 -- 10.20.193.90:0/656281457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010fbf0 msgr2=0x7f6da0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/656281457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010fbf0 0x7f6da0114c30 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=8826289842116400541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d900099a0 tx=0x7f6d90037780 comp rx=0 tx=0).stop 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 -- 10.20.193.90:0/656281457 shutdown_connections 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/656281457 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6da0115410 0x7f6da0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/656281457 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010fbf0 0x7f6da0114c30 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=8826289842116400541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/656281457 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da010f200 0x7f6da010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 -- 10.20.193.90:0/656281457 >> 10.20.193.90:0/656281457 conn(0x7f6da00ecac0 msgr2=0x7f6da010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 -- 10.20.193.90:0/656281457 shutdown_connections 2026-02-19T21:02:43.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.995+0000 7f6da5a986c0 1 -- 10.20.193.90:0/656281457 wait complete. 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 Processor -- start 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 -- start start 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 0x7f6da011c7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da0115410 0x7f6da011cce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6da01220a0 0x7f6da0122540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0122ab0 con 0x7f6da010f200 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0122c20 con 0x7f6da0115410 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6da5a986c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0122de0 con 0x7f6da01220a0 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6d9f7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 0x7f6da011c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6d9f7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 0x7f6da011c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38430/0 (socket says 10.20.193.90:38430) 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6d9f7fe6c0 1 -- 10.20.193.90:0/4175227174 learned_addr learned my addr 10.20.193.90:0/4175227174 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6d9effd6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da0115410 0x7f6da011cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.996+0000 7f6d9ffff6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6da01220a0 0x7f6da0122540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.997+0000 7f6d9effd6c0 1 -- 10.20.193.90:0/4175227174 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6da01220a0 msgr2=0x7f6da0122540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.997+0000 7f6d9effd6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6da01220a0 0x7f6da0122540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.997+0000 7f6d9effd6c0 1 -- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 msgr2=0x7f6da011c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9effd6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 0x7f6da011c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9effd6c0 1 -- 10.20.193.90:0/4175227174 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c0094c0 con 0x7f6da0115410 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9f7fe6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 0x7f6da011c7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9effd6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da0115410 0x7f6da011cce0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6da00557d0 tx=0x7f6d90004670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d900026b0 con 0x7f6da0115410 2026-02-19T21:02:43.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6d90002cd0 con 0x7f6da0115410 2026-02-19T21:02:43.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d90009590 con 0x7f6da0115410 2026-02-19T21:02:43.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da0163520 con 0x7f6da0115410 2026-02-19T21:02:43.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.998+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d9003fa20 con 0x7f6da0115410 2026-02-19T21:02:43.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.999+0000 7f5992ffd6c0 1 -- 10.20.193.90:0/1409957387 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f59a0008e60 con 0x7f59a411de30 2026-02-19T21:02:43.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:42.999+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f6d9003fbb0 con 0x7f6da0115410 2026-02-19T21:02:43.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f6d9cff96c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d7403f820 0x7f6d7405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6d9007dbb0 con 0x7f6da0115410 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/2913849144 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 msgr2=0x7f4d1c0633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/2913849144 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c0633c0 secure :-1 s=READY pgs=15 gs=3 cs=0 l=1 c_cookie=1337012139610130305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d0c0098a0 tx=0x7f4d0c02ec70 comp rx=0 tx=0).stop 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/2913849144 shutdown_connections 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/2913849144 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c159a50 0x7f4d1c179eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/2913849144 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c0633c0 unknown :-1 s=CLOSED pgs=15 gs=3 cs=0 l=1 c_cookie=1337012139610130305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/2913849144 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c066960 0x7f4d1c062970 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/2913849144 >> 10.20.193.90:0/2913849144 conn(0x7f4d1c0eca60 msgr2=0x7f4d1c10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/2913849144 shutdown_connections 2026-02-19T21:02:43.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/2913849144 wait complete. 2026-02-19T21:02:43.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da01104d0 con 0x7f6da0115410 2026-02-19T21:02:43.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.000+0000 7f6d9f7fe6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d7403f820 0x7f6d7405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 Processor -- start 2026-02-19T21:02:43.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 -- start start 2026-02-19T21:02:43.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f6d9f7fe6c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d7403f820 0x7f6d7405fcd0 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8c005c80 tx=0x7f6d8c009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c163380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c159a50 0x7f4d1c1638c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 0x7f4d1c169120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c169690 con 0x7f4d1c159a50 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c169800 con 0x7f4d1c062f90 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.001+0000 7f4d21b4c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1699c0 con 0x7f4d1c168c80 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1b7fe6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c163380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 0x7f4d1c169120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 0x7f4d1c169120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:46864/0 (socket says 10.20.193.90:46864) 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 -- 10.20.193.90:0/1770072953 learned_addr learned my addr 10.20.193.90:0/1770072953 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1affd6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c159a50 0x7f4d1c1638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 -- 10.20.193.90:0/1770072953 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 msgr2=0x7f4d1c163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c163380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 -- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c159a50 msgr2=0x7f4d1c1638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c159a50 0x7f4d1c1638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1bfff6c0 1 -- 10.20.193.90:0/1770072953 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c0094c0 con 0x7f4d1c168c80 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1affd6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c159a50 0x7f4d1c1638c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.002+0000 7f4d1b7fe6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c163380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f4d1bfff6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 0x7f4d1c169120 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d10006ea0 tx=0x7f4d1000ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d10003c40 con 0x7f4d1c168c80 2026-02-19T21:02:43.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c157910 con 0x7f4d1c168c80 2026-02-19T21:02:43.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4d10003da0 con 0x7f4d1c168c80 2026-02-19T21:02:43.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d10003c40 con 0x7f4d1c168c80 2026-02-19T21:02:43.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c157da0 con 0x7f4d1c168c80 2026-02-19T21:02:43.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.003+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d9003da00 con 0x7f6da0115410 2026-02-19T21:02:43.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f4d1000dcc0 con 0x7f4d1c168c80 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f4d18ff96c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf403f880 0x7f4cf405fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4d10052eb0 con 0x7f4d1c168c80 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f4d1b7fe6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf403f880 0x7f4cf405fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f598003f820 msgr2=0x7f598005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f59abd836c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f598003f820 0x7f598005fcd0 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5994006f40 tx=0x7f5994009210 comp rx=0 tx=0).stop 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a411de30 msgr2=0x7f59a411e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.004+0000 7f59abd836c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a411de30 0x7f59a411e2d0 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f59a0041760 tx=0x7f59a00081c0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 shutdown_connections 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f598003f820 0x7f598005fcd0 unknown :-1 s=CLOSED pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f59a411de30 0x7f59a411e2d0 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f59a4115410 0x7f59a4118a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 --2- 10.20.193.90:0/1409957387 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f59a410f200 0x7f59a4118530 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 >> 10.20.193.90:0/1409957387 conn(0x7f59a40ecac0 msgr2=0x7f59a410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 shutdown_connections 2026-02-19T21:02:43.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f59abd836c0 1 -- 10.20.193.90:0/1409957387 wait complete. 2026-02-19T21:02:43.014 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.005+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c063e80 con 0x7f4d1c168c80 2026-02-19T21:02:43.014 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.006+0000 7f4d1b7fe6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf403f880 0x7f4cf405fd30 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d08005b40 tx=0x7f4d08009310 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.014 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:43.014 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.006+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f4dec11c0d0 con 0x7f4dec10cf70 2026-02-19T21:02:43.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.009+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d1000eda0 con 0x7f4d1c168c80 2026-02-19T21:02:43.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.010+0000 7f4dcbfff6c0 1 -- 10.20.193.90:0/2103152243 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v20)=0 v20) ==== 116+0+0 (secure 0 0 0) 0x7f4de0034040 con 0x7f4dec10cf70 2026-02-19T21:02:43.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 -- 10.20.193.90:0/863778348 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14159ab0 msgr2=0x7fde14179e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/863778348 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14159ab0 0x7fde14179e90 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=14471828571698599385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde10006fd0 tx=0x7fde1002fd20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 -- 10.20.193.90:0/863778348 shutdown_connections 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/863778348 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14159ab0 0x7fde14179e90 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=14471828571698599385 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/863778348 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14060ca0 0x7fde140610d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/863778348 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde14062290 0x7fde14060760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 -- 10.20.193.90:0/863778348 >> 10.20.193.90:0/863778348 conn(0x7fde140ea870 msgr2=0x7fde1410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 -- 10.20.193.90:0/863778348 shutdown_connections 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.013+0000 7fde1b2316c0 1 -- 10.20.193.90:0/863778348 wait complete. 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.014+0000 7fde1b2316c0 1 Processor -- start 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.014+0000 7fde1b2316c0 1 -- start start 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.014+0000 7fde1b2316c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14060ca0 0x7fde140f2280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde1b2316c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 0x7fde140f27c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde1b2316c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde14159ab0 0x7fde140f7b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde18fa26c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14060ca0 0x7fde140f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde1b2316c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde140f81d0 con 0x7fde14062290 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde1b2316c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde140f8340 con 0x7fde14159ab0 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde1b2316c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde140f8500 con 0x7fde14060ca0 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 0x7fde140f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 0x7fde140f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38480/0 (socket says 10.20.193.90:38480) 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 -- 10.20.193.90:0/836617357 learned_addr learned my addr 10.20.193.90:0/836617357 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4dc003f820 msgr2=0x7f4dc005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4dc003f820 0x7f4dc005fcd0 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dec121910 tx=0x7f4dd4009310 comp rx=0 tx=0).stop 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 msgr2=0x7f4dec11af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec11af80 secure :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4de00098c0 tx=0x7f4de002fc10 comp rx=0 tx=0).stop 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde197a36c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde14159ab0 0x7fde140f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 -- 10.20.193.90:0/836617357 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14060ca0 msgr2=0x7fde140f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14060ca0 0x7fde140f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 -- 10.20.193.90:0/836617357 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde14159ab0 msgr2=0x7fde140f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde14159ab0 0x7fde140f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde0bfff6c0 1 -- 10.20.193.90:0/836617357 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1000a5b0 con 0x7fde14062290 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.015+0000 7fde18fa26c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14060ca0 0x7fde140f2280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:02:43.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 shutdown_connections 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4dc003f820 0x7f4dc005fcd0 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4dec120880 0x7f4dec120d20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4dec113180 0x7f4dec11b4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 --2- 10.20.193.90:0/2103152243 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4dec10cf70 0x7f4dec11af80 unknown :-1 s=CLOSED pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 >> 10.20.193.90:0/2103152243 conn(0x7f4dec0ea870 msgr2=0x7f4dec10ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7fde0bfff6c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 0x7fde140f27c0 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddfc00b800 tx=0x7fddfc00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 shutdown_connections 2026-02-19T21:02:43.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7f4df11cf6c0 1 -- 10.20.193.90:0/2103152243 wait complete. 2026-02-19T21:02:43.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddfc004a80 con 0x7fde14062290 2026-02-19T21:02:43.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fddfc009030 con 0x7fde14062290 2026-02-19T21:02:43.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.016+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddfc005650 con 0x7fde14062290 2026-02-19T21:02:43.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.017+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde140f87e0 con 0x7fde14062290 2026-02-19T21:02:43.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.017+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde140f8ea0 con 0x7fde14062290 2026-02-19T21:02:43.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.018+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fddfc004060 con 0x7fde14062290 2026-02-19T21:02:43.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.018+0000 7fde09ffb6c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fddf003f870 0x7fddf005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.018+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fddfc0521e0 con 0x7fde14062290 2026-02-19T21:02:43.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.018+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde140f8a00 con 0x7fde14062290 2026-02-19T21:02:43.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.018+0000 7fde18fa26c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fddf003f870 0x7fddf005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.019+0000 7fde18fa26c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fddf003f870 0x7fddf005fd20 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde04004750 tx=0x7fde04005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.022+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fddfc0071c0 con 0x7fde14062290 2026-02-19T21:02:43.029 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:43.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.046 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.056 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.055+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fa7a0113b30 con 0x7fa7a0113760 2026-02-19T21:02:43.056 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.055+0000 7fd2577fe6c0 1 -- 10.20.193.90:0/3634279629 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd25002fd80 con 0x7fd26010f1e0 2026-02-19T21:02:43.057 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.055+0000 7fd2670f96c0 1 -- 10.20.193.90:0/3634279629 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd26010f1e0 msgr2=0x7fd26010f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.057 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.055+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/3634279629 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd26010f1e0 0x7fd26010f5b0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=14050743274765360070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd250009970 tx=0x7fd25002ed10 comp rx=0 tx=0).stop 2026-02-19T21:02:43.057 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 -- 10.20.193.90:0/3634279629 shutdown_connections 2026-02-19T21:02:43.057 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/3634279629 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd2601153f0 0x7fd260175d90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.057 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/3634279629 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd26010fbd0 0x7fd260114c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.057 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/3634279629 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd26010f1e0 0x7fd26010f5b0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=14050743274765360070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 -- 10.20.193.90:0/3634279629 >> 10.20.193.90:0/3634279629 conn(0x7fd2600ecaa0 msgr2=0x7fd26010ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 -- 10.20.193.90:0/3634279629 shutdown_connections 2026-02-19T21:02:43.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.056+0000 7fd2670f96c0 1 -- 10.20.193.90:0/3634279629 wait complete. 2026-02-19T21:02:43.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 Processor -- start 2026-02-19T21:02:43.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 -- start start 2026-02-19T21:02:43.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd26010f1e0 0x7fd26011d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.059 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 0x7fd26011d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.059 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd260122b30 0x7fd260122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.059 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd260123510 con 0x7fd2601153f0 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd260123650 con 0x7fd260122b30 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd2670f96c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd260123810 con 0x7fd26010f1e0 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd257fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 0x7fd26011d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd257fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 0x7fd26011d770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38500/0 (socket says 10.20.193.90:38500) 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd257fff6c0 1 -- 10.20.193.90:0/64084116 learned_addr learned my addr 10.20.193.90:0/64084116 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd264e6a6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd26010f1e0 0x7fd26011d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.057+0000 7fd26566b6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd260122b30 0x7fd260122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd257fff6c0 1 -- 10.20.193.90:0/64084116 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd26010f1e0 msgr2=0x7fd26011d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd257fff6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd26010f1e0 0x7fd26011d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd257fff6c0 1 -- 10.20.193.90:0/64084116 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd260122b30 msgr2=0x7fd260122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd257fff6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd260122b30 0x7fd260122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd257fff6c0 1 -- 10.20.193.90:0/64084116 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd250009590 con 0x7fd2601153f0 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd264e6a6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd26010f1e0 0x7fd26011d230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:02:43.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.058+0000 7fd257fff6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 0x7fd26011d770 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd24800b650 tx=0x7fd24800bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.059+0000 7fa78f7fe6c0 1 -- 10.20.193.90:0/1465368555 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fa79400e040 con 0x7fa7a0113760 2026-02-19T21:02:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.060+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2480044a0 con 0x7fd2601153f0 2026-02-19T21:02:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.060+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd248009030 con 0x7fd2601153f0 2026-02-19T21:02:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.060+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd24801fc80 con 0x7fd2601153f0 2026-02-19T21:02:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.060+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2601750d0 con 0x7fd2601153f0 2026-02-19T21:02:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.060+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd260175560 con 0x7fd2601153f0 2026-02-19T21:02:43.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.061+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2601104b0 con 0x7fd2601153f0 2026-02-19T21:02:43.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.061+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fd24800c410 con 0x7fd2601153f0 2026-02-19T21:02:43.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.061+0000 7fd255ffb6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd23c03f870 0x7fd23c05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.061+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fd2480624f0 con 0x7fd2601153f0 2026-02-19T21:02:43.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.061+0000 7fd264e6a6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd23c03f870 0x7fd23c05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.062+0000 7fd264e6a6c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd23c03f870 0x7fd23c05fd20 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd250005b40 tx=0x7fd2500023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa77c03f820 msgr2=0x7fa77c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa77c03f820 0x7fa77c05fcd0 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7a0128080 tx=0x7fa790005e60 comp rx=0 tx=0).stop 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 msgr2=0x7fa7a0121740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 0x7fa7a0121740 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa794006ea0 tx=0x7fa79400ced0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 shutdown_connections 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa77c03f820 0x7fa77c05fcd0 unknown :-1 s=CLOSED pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa7a0126ff0 0x7fa7a0127490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa7a01198b0 0x7fa7a0121c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 --2- 10.20.193.90:0/1465368555 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa7a0113760 0x7fa7a0121740 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 >> 10.20.193.90:0/1465368555 conn(0x7fa7a0060720 msgr2=0x7fa7a0114e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 shutdown_connections 2026-02-19T21:02:43.065 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.063+0000 7fa7a88e86c0 1 -- 10.20.193.90:0/1465368555 wait complete. 2026-02-19T21:02:43.065 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.064+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd248008260 con 0x7fd2601153f0 2026-02-19T21:02:43.097 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2707024316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d2410f200 msgr2=0x7f8d2410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2707024316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d2410f200 0x7f8d2410f5d0 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=11663084321911864078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d100098a0 tx=0x7f8d1002ec40 comp rx=0 tx=0).stop 2026-02-19T21:02:43.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2707024316 shutdown_connections 2026-02-19T21:02:43.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2707024316 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8d24115410 0x7f8d24175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2707024316 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d2410fbf0 0x7f8d24114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2707024316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d2410f200 0x7f8d2410f5d0 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=11663084321911864078 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.104 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2707024316 >> 10.20.193.90:0/2707024316 conn(0x7f8d240ecac0 msgr2=0x7f8d2410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.104 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2707024316 shutdown_connections 2026-02-19T21:02:43.104 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.101+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2707024316 wait complete. 2026-02-19T21:02:43.105 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.102+0000 7f8d2a42f6c0 1 Processor -- start 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.102+0000 7f8d2a42f6c0 1 -- start start 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d2a42f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8d2410f200 0x7f8d240f9060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d2a42f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 0x7f8d24175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d2a42f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d240f9690 0x7f8d240fe960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d2a42f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240f9d80 con 0x7f8d24115410 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d2a42f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240feea0 con 0x7f8d240f9690 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d2a42f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d240ff060 con 0x7f8d2410f200 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 0x7f8d24175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 0x7f8d24175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38516/0 (socket says 10.20.193.90:38516) 2026-02-19T21:02:43.106 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 -- 10.20.193.90:0/2607374746 learned_addr learned my addr 10.20.193.90:0/2607374746 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.107 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d289a16c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d240f9690 0x7f8d240fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.107 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d23fff6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8d2410f200 0x7f8d240f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.107 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 -- 10.20.193.90:0/2607374746 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8d2410f200 msgr2=0x7f8d240f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.108 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8d2410f200 0x7f8d240f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.108 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 -- 10.20.193.90:0/2607374746 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d240f9690 msgr2=0x7f8d240fe960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.108 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d240f9690 0x7f8d240fe960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.108 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 -- 10.20.193.90:0/2607374746 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d14009590 con 0x7f8d24115410 2026-02-19T21:02:43.108 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.109 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.110 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d289a16c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d240f9690 0x7f8d240fe960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.103+0000 7f8d237fe6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 0x7f8d24175cb0 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d14005b20 tx=0x7f8d1400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.104+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d140044a0 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.104+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8d14009030 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.104+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8d140071c0 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.104+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d100094c0 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.104+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d240ff640 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.104+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d241104d0 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.105+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f8d140026b0 con 0x7f8d24115410 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.105+0000 7f8d217fa6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8cf803f820 0x7f8cf805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.111 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.105+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8d140513b0 con 0x7f8d24115410 2026-02-19T21:02:43.112 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.105+0000 7f8d23fff6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8cf803f820 0x7f8cf805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.112 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.106+0000 7f8d23fff6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8cf803f820 0x7f8cf805fcd0 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d100097f0 tx=0x7f8d100023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.112 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.107+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8d14010de0 con 0x7f8d24115410 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1652189402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 msgr2=0x7f2ef8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1652189402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef8175db0 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=1314719113501213165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ee800aa70 tx=0x7f2ee802fde0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1652189402 shutdown_connections 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1652189402 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef8175db0 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=1314719113501213165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1652189402 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ef810fbf0 0x7f2ef8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1652189402 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ef810f200 0x7f2ef810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1652189402 >> 10.20.193.90:0/1652189402 conn(0x7f2ef80ecac0 msgr2=0x7f2ef810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1652189402 shutdown_connections 2026-02-19T21:02:43.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1652189402 wait complete. 2026-02-19T21:02:43.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 -- 10.20.193.90:0/951513768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a00095b0 msgr2=0x7f88a00099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/951513768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a00095b0 0x7f88a00099e0 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=16336329926898642226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8890009970 tx=0x7f889002ed20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 -- 10.20.193.90:0/951513768 shutdown_connections 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/951513768 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88a0101690 0x7f88a0121af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/951513768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a00095b0 0x7f88a00099e0 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=16336329926898642226 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/951513768 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88a000cf80 0x7f88a0008f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 -- 10.20.193.90:0/951513768 >> 10.20.193.90:0/951513768 conn(0x7f88a00946c0 msgr2=0x7f88a00b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 -- 10.20.193.90:0/951513768 shutdown_connections 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.115+0000 7f88adcba6c0 1 -- 10.20.193.90:0/951513768 wait complete. 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 Processor -- start 2026-02-19T21:02:43.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 -- start start 2026-02-19T21:02:43.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 Processor -- start 2026-02-19T21:02:43.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 -- start start 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88a00095b0 0x7f88a010afa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 0x7f88a010b4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88a01108a0 0x7f88a0110d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01112b0 con 0x7f88a0101690 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0111420 con 0x7f88a00095b0 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88adcba6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88a01115e0 con 0x7f88a01108a0 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 0x7f88a010b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 0x7f88a010b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38536/0 (socket says 10.20.193.90:38536) 2026-02-19T21:02:43.122 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 -- 10.20.193.90:0/3621939215 learned_addr learned my addr 10.20.193.90:0/3621939215 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.122 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ef810f200 0x7f2ef811d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.122 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef811d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.122 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ef8122af0 0x7f2ef8122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.123 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8123500 con 0x7f2ef8115410 2026-02-19T21:02:43.123 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8123670 con 0x7f2ef810f200 2026-02-19T21:02:43.123 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2efd7546c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef8123830 con 0x7f2ef8122af0 2026-02-19T21:02:43.123 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88accb86c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88a00095b0 0x7f88a010afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.123 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f88ad4b96c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88a01108a0 0x7f88a0110d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 -- 10.20.193.90:0/3621939215 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88a01108a0 msgr2=0x7f88a0110d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88a01108a0 0x7f88a0110d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef811d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef811d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38540/0 (socket says 10.20.193.90:38540) 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 -- 10.20.193.90:0/1866970872 learned_addr learned my addr 10.20.193.90:0/1866970872 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef77fe6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ef8122af0 0x7f2ef8122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.124 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef6ffd6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ef810f200 0x7f2ef811d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.125 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 -- 10.20.193.90:0/3621939215 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88a00095b0 msgr2=0x7f88a010afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.125 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88a00095b0 0x7f88a010afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.125 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 -- 10.20.193.90:0/3621939215 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8890009590 con 0x7f88a0101690 2026-02-19T21:02:43.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 -- 10.20.193.90:0/1866970872 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ef8122af0 msgr2=0x7f2ef8122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ef8122af0 0x7f2ef8122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 -- 10.20.193.90:0/1866970872 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ef810f200 msgr2=0x7f2ef811d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ef810f200 0x7f2ef811d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f2ef67fc6c0 1 -- 10.20.193.90:0/1866970872 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee800a660 con 0x7f2ef8115410 2026-02-19T21:02:43.127 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.116+0000 7f889ffff6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 0x7f88a010b4e0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8890031fd0 tx=0x7f889002fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.127 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8890002ae0 con 0x7f88a0101690 2026-02-19T21:02:43.127 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f2ef67fc6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef811d730 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ee000b800 tx=0x7f2ee000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.127 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a00ff4f0 con 0x7f88a0101690 2026-02-19T21:02:43.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8890005e90 con 0x7f88a0101690 2026-02-19T21:02:43.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88900363f0 con 0x7f88a0101690 2026-02-19T21:02:43.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a00ff970 con 0x7f88a0101690 2026-02-19T21:02:43.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ee0004a80 con 0x7f2ef8115410 2026-02-19T21:02:43.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2ee0009030 con 0x7f2ef8115410 2026-02-19T21:02:43.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ee000cd30 con 0x7f2ef8115410 2026-02-19T21:02:43.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef8163ce0 con 0x7f2ef8115410 2026-02-19T21:02:43.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef8164170 con 0x7f2ef8115410 2026-02-19T21:02:43.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.117+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f8890002c60 con 0x7f88a0101690 2026-02-19T21:02:43.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f889dffb6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f888403f820 0x7f888405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f88900762b0 con 0x7f88a0101690 2026-02-19T21:02:43.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef81104d0 con 0x7f2ef8115410 2026-02-19T21:02:43.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f2ee0004fe0 con 0x7f2ef8115410 2026-02-19T21:02:43.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f88accb86c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f888403f820 0x7f888405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f2ed7fff6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ecc03f870 0x7f2ecc05fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a000a4a0 con 0x7f88a0101690 2026-02-19T21:02:43.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f2ef6ffd6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ecc03f870 0x7f2ecc05fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.118+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2ee0008030 con 0x7f2ef8115410 2026-02-19T21:02:43.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.119+0000 7f2ef6ffd6c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ecc03f870 0x7f2ecc05fd20 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eec004750 tx=0x7f2eec009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.119+0000 7f88accb86c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f888403f820 0x7f888405fcd0 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8898004750 tx=0x7f8898009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.121+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ee0007550 con 0x7f2ef8115410 2026-02-19T21:02:43.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.121+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f04e81739a0 con 0x7f04e8060760 2026-02-19T21:02:43.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.123+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f889003a3f0 con 0x7f88a0101690 2026-02-19T21:02:43.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.126+0000 7f04e4ff96c0 1 -- 10.20.193.90:0/691957536 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f04d401a540 con 0x7f04e8060760 2026-02-19T21:02:43.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 -- 10.20.193.90:0/2501893892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10d7a0 msgr2=0x7f2c8c1127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 --2- 10.20.193.90:0/2501893892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10d7a0 0x7f2c8c1127e0 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=12790980050785046689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7c0099a0 tx=0x7f2c7c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04bc03f870 msgr2=0x7f04bc05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04bc03f870 0x7f04bc05fd20 secure :-1 s=READY pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04e810c010 tx=0x7f04d80023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 msgr2=0x7f04e8172800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 0x7f04e8172800 secure :-1 s=READY pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d4009490 tx=0x7f04d400bc50 comp rx=0 tx=0).stop 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 -- 10.20.193.90:0/2501893892 shutdown_connections 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 --2- 10.20.193.90:0/2501893892 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c8c112fc0 0x7f2c8c173960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 --2- 10.20.193.90:0/2501893892 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10d7a0 0x7f2c8c1127e0 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=12790980050785046689 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 --2- 10.20.193.90:0/2501893892 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c10d180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 -- 10.20.193.90:0/2501893892 >> 10.20.193.90:0/2501893892 conn(0x7f2c8c0ea690 msgr2=0x7f2c8c10aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 -- 10.20.193.90:0/2501893892 shutdown_connections 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f2c919836c0 1 -- 10.20.193.90:0/2501893892 wait complete. 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 shutdown_connections 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04bc03f870 0x7f04bc05fd20 unknown :-1 s=CLOSED pgs=22 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e8155620 0x7f04e8057230 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e8061070 0x7f04e8172d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 --2- 10.20.193.90:0/691957536 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e8060760 0x7f04e8172800 unknown :-1 s=CLOSED pgs=13 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 >> 10.20.193.90:0/691957536 conn(0x7f04e80ea870 msgr2=0x7f04e810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.129+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f30641115f0 con 0x7f3064110c00 2026-02-19T21:02:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 shutdown_connections 2026-02-19T21:02:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f04eddb56c0 1 -- 10.20.193.90:0/691957536 wait complete. 2026-02-19T21:02:43.138 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 Processor -- start 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 -- start start 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c0f8fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c8c112fc0 0x7f2c8c173860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c0f95d0 0x7f2c8c0fe8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0f9cc0 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0fede0 con 0x7f2c8c0f95d0 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c919836c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c0fefa0 con 0x7f2c8c112fc0 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c0f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c0f8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38548/0 (socket says 10.20.193.90:38548) 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 -- 10.20.193.90:0/60915168 learned_addr learned my addr 10.20.193.90:0/60915168 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c911826c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c0f95d0 0x7f2c8c0fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c83fff6c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c8c112fc0 0x7f2c8c173860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 -- 10.20.193.90:0/60915168 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c8c112fc0 msgr2=0x7f2c8c173860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c8c112fc0 0x7f2c8c173860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 -- 10.20.193.90:0/60915168 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c0f95d0 msgr2=0x7f2c8c0fe8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c0f95d0 0x7f2c8c0fe8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c909816c0 1 -- 10.20.193.90:0/60915168 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7c009590 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.130+0000 7f2c911826c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c0f95d0 0x7f2c8c0fe8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:02:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.131+0000 7f2c909816c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c0f8fa0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7400b710 tx=0x7f2c7400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.132+0000 7f30527fc6c0 1 -- 10.20.193.90:0/3093284459 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f3058033560 con 0x7f3064110c00 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.132+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c74004250 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.133+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c0ff280 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.133+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2c74009070 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.133+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c0ffa10 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.133+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c74004250 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.134+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f2c7400cae0 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.134+0000 7f2c81ffb6c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c5c03f880 0x7f2c5c05fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.134+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c8c10e080 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.134+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2c74050dc0 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.134+0000 7f2c83fff6c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c5c03f880 0x7f2c5c05fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.135+0000 7f2c83fff6c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c5c03f880 0x7f2c5c05fd30 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7c009260 tx=0x7f2c7c0023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.136+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f304003f880 msgr2=0x7f304005fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.136+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f304003f880 0x7f304005fd30 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30640fb120 tx=0x7f3054006cd0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.136+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 msgr2=0x7f30640f4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.136+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f30640f4790 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30580092b0 tx=0x7f305802fd50 comp rx=0 tx=0).stop 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 shutdown_connections 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f304003f880 0x7f304005fd30 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30640fa090 0x7f30640fa530 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30641153e0 0x7f30640f4cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 --2- 10.20.193.90:0/3093284459 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3064110c00 0x7f30640f4790 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 >> 10.20.193.90:0/3093284459 conn(0x7f30640ecac0 msgr2=0x7f30640ef020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 shutdown_connections 2026-02-19T21:02:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.137+0000 7f306b6356c0 1 -- 10.20.193.90:0/3093284459 wait complete. 2026-02-19T21:02:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.138+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c7400cdc0 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.139+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}] v 0) -- 0x7f6da011d8f0 con 0x7f6da0115410 2026-02-19T21:02:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.142+0000 7f6d9cff96c0 1 -- 10.20.193.90:0/4175227174 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_use_global_snaprealm_seq_for_subvol}]=0 v24)=0 v24) ==== 141+0+0 (secure 0 0 0) 0x7f6d9003d3c0 con 0x7f6da0115410 2026-02-19T21:02:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.146+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d7403f820 msgr2=0x7f6d7405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.146+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d7403f820 0x7f6d7405fcd0 secure :-1 s=READY pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8c005c80 tx=0x7f6d8c009260 comp rx=0 tx=0).stop 2026-02-19T21:02:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.146+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da0115410 msgr2=0x7f6da011cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.146+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da0115410 0x7f6da011cce0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6da00557d0 tx=0x7f6d90004670 comp rx=0 tx=0).stop 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.146+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 shutdown_connections 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d7403f820 0x7f6d7405fcd0 unknown :-1 s=CLOSED pgs=24 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6da01220a0 0x7f6da0122540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6da0115410 0x7f6da011cce0 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 --2- 10.20.193.90:0/4175227174 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6da010f200 0x7f6da011c7a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 >> 10.20.193.90:0/4175227174 conn(0x7f6da00ecac0 msgr2=0x7f6da010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 shutdown_connections 2026-02-19T21:02:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.147+0000 7f6da5a986c0 1 -- 10.20.193.90:0/4175227174 wait complete. 2026-02-19T21:02:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.151+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f4d1c1644d0 con 0x7f4d1c168c80 2026-02-19T21:02:43.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.155+0000 7f4d18ff96c0 1 -- 10.20.193.90:0/1770072953 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f4d1000e550 con 0x7f4d1c168c80 2026-02-19T21:02:43.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf403f880 msgr2=0x7f4cf405fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fde14061c70 con 0x7fde14062290 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf403f880 0x7f4cf405fd30 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d08005b40 tx=0x7f4d08009310 comp rx=0 tx=0).stop 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 msgr2=0x7f4d1c169120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 0x7f4d1c169120 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d10006ea0 tx=0x7f4d1000ce50 comp rx=0 tx=0).stop 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 shutdown_connections 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf403f880 0x7f4cf405fd30 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d1c168c80 0x7f4d1c169120 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d1c159a50 0x7f4d1c1638c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.159+0000 7f4d21b4c6c0 1 --2- 10.20.193.90:0/1770072953 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d1c062f90 0x7f4d1c163380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.160+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 >> 10.20.193.90:0/1770072953 conn(0x7f4d1c0eca60 msgr2=0x7f4d1c10ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.160+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 shutdown_connections 2026-02-19T21:02:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.160+0000 7f4d21b4c6c0 1 -- 10.20.193.90:0/1770072953 wait complete. 2026-02-19T21:02:43.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.162+0000 7fde09ffb6c0 1 -- 10.20.193.90:0/836617357 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7fddfc00d550 con 0x7fde14062290 2026-02-19T21:02:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.167+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fddf003f870 msgr2=0x7fddf005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.167+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fddf003f870 0x7fddf005fd20 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fde04004750 tx=0x7fde04005f10 comp rx=0 tx=0).stop 2026-02-19T21:02:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.167+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 msgr2=0x7fde140f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.167+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 0x7fde140f27c0 secure :-1 s=READY pgs=113 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddfc00b800 tx=0x7fddfc00bcd0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 -- 10.20.193.90:0/553743151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c0155910 msgr2=0x7f94c0175cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 --2- 10.20.193.90:0/553743151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c0155910 0x7f94c0175cf0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=16213363795399779231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94bc00aa40 tx=0x7f94bc02fdf0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 shutdown_connections 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fddf003f870 0x7fddf005fd20 unknown :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde14159ab0 0x7fde140f7b80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde14062290 0x7fde140f27c0 unknown :-1 s=CLOSED pgs=113 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 --2- 10.20.193.90:0/836617357 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde14060ca0 0x7fde140f2280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 >> 10.20.193.90:0/836617357 conn(0x7fde140ea870 msgr2=0x7fde1410efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 -- 10.20.193.90:0/553743151 shutdown_connections 2026-02-19T21:02:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 --2- 10.20.193.90:0/553743151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c0155910 0x7f94c0175cf0 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=16213363795399779231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 --2- 10.20.193.90:0/553743151 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94c010bb00 0x7f94c01553d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 --2- 10.20.193.90:0/553743151 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94c010b1f0 0x7f94c010b5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 -- 10.20.193.90:0/553743151 >> 10.20.193.90:0/553743151 conn(0x7f94c0063a80 msgr2=0x7f94c0064270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 -- 10.20.193.90:0/553743151 shutdown_connections 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7f94c77286c0 1 -- 10.20.193.90:0/553743151 wait complete. 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.168+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 shutdown_connections 2026-02-19T21:02:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.169+0000 7fde1b2316c0 1 -- 10.20.193.90:0/836617357 wait complete. 2026-02-19T21:02:43.173 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.169+0000 7f94c77286c0 1 Processor -- start 2026-02-19T21:02:43.173 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.169+0000 7f94c77286c0 1 -- start start 2026-02-19T21:02:43.173 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.169+0000 7f94c77286c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 0x7f94c00ebc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.173 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.169+0000 7f94c77286c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94c010bb00 0x7f94c00ec1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.173 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c77286c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94c0155910 0x7f94c00f1590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.173 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c77286c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00f1be0 con 0x7f94c010b1f0 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c77286c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00f1d50 con 0x7f94c010bb00 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c77286c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94c00f1f10 con 0x7f94c0155910 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 0x7f94c00ebc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 0x7f94c00ebc90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38562/0 (socket says 10.20.193.90:38562) 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 -- 10.20.193.90:0/1006299486 learned_addr learned my addr 10.20.193.90:0/1006299486 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c4c986c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94c010bb00 0x7f94c00ec1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c5c9a6c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94c0155910 0x7f94c00f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 -- 10.20.193.90:0/1006299486 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94c0155910 msgr2=0x7f94c00f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94c0155910 0x7f94c00f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 -- 10.20.193.90:0/1006299486 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94c010bb00 msgr2=0x7f94c00ec1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.174 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94c010bb00 0x7f94c00ec1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.170+0000 7f94c54996c0 1 -- 10.20.193.90:0/1006299486 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc00a660 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.171+0000 7f94c54996c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 0x7f94c00ebc90 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b000b6c0 tx=0x7f94b000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.171+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b00044a0 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.171+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94c00f21f0 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.171+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f94b000be50 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.171+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94b000cd00 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.171+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94c0151d60 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.172+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94c00650b0 con 0x7f94c010b1f0 2026-02-19T21:02:43.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.172+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f94b00026b0 con 0x7f94c010b1f0 2026-02-19T21:02:43.176 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.172+0000 7f94ae7fc6c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f949c03f820 0x7f949c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.176 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.172+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f94b00510d0 con 0x7f94c010b1f0 2026-02-19T21:02:43.176 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.172+0000 7f94c4c986c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f949c03f820 0x7f949c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.176 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.173+0000 7f94c4c986c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f949c03f820 0x7f949c05fcd0 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c00f2620 tx=0x7f94b4009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.176+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94b000de40 con 0x7f94c010b1f0 2026-02-19T21:02:43.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: mgrmap e11: x(active, since 1.008s) 2026-02-19T21:02:43.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.193 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial175", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1119199763' entity='client.admin' 2026-02-19T21:02:43.194 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2625114693' entity='client.admin' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3260520321' entity='client.admin' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1668589157' entity='client.admin' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-19T21:02:43.195 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2444388618' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.196 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1465368555' entity='client.admin' 2026-02-19T21:02:43.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.200 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 -- 10.20.193.90:0/238338186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010fbd0 msgr2=0x7f4070114c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 --2- 10.20.193.90:0/238338186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010fbd0 0x7f4070114c10 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=14385208971268997902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f405c0099a0 tx=0x7f405c02ed00 comp rx=0 tx=0).stop 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 -- 10.20.193.90:0/238338186 shutdown_connections 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 --2- 10.20.193.90:0/238338186 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f40701153f0 0x7f4070175d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 --2- 10.20.193.90:0/238338186 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010fbd0 0x7f4070114c10 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=14385208971268997902 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 --2- 10.20.193.90:0/238338186 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f407010f1e0 0x7f407010f5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 -- 10.20.193.90:0/238338186 >> 10.20.193.90:0/238338186 conn(0x7f40700ecaa0 msgr2=0x7f407010ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 -- 10.20.193.90:0/238338186 shutdown_connections 2026-02-19T21:02:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7f40788306c0 1 -- 10.20.193.90:0/238338186 wait complete. 2026-02-19T21:02:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.200+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fd26010f5b0 con 0x7fd2601153f0 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 Processor -- start 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 -- start start 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 0x7f407017d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f40701153f0 0x7f407017da00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4070118d00 0x7f40701191a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40701197a0 con 0x7f407010f1e0 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4070119910 con 0x7f40701153f0 2026-02-19T21:02:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40788306c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4070119ad0 con 0x7f4070118d00 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 0x7f407017d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 0x7f407017d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38576/0 (socket says 10.20.193.90:38576) 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 -- 10.20.193.90:0/671516246 learned_addr learned my addr 10.20.193.90:0/671516246 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f4075da06c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f40701153f0 0x7f407017da00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f4076da26c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4070118d00 0x7f40701191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 -- 10.20.193.90:0/671516246 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4070118d00 msgr2=0x7f40701191a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4070118d00 0x7f40701191a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 -- 10.20.193.90:0/671516246 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f40701153f0 msgr2=0x7f407017da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f40701153f0 0x7f407017da00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.202+0000 7f40765a16c0 1 -- 10.20.193.90:0/671516246 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406400a5b0 con 0x7f407010f1e0 2026-02-19T21:02:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.203+0000 7f40765a16c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 0x7f407017d4c0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f406800b710 tx=0x7f406800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.203+0000 7fd255ffb6c0 1 -- 10.20.193.90:0/64084116 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7fd248008260 con 0x7fd2601153f0 2026-02-19T21:02:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.204+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4068004250 con 0x7f407010f1e0 2026-02-19T21:02:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.204+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4068002d80 con 0x7f407010f1e0 2026-02-19T21:02:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.204+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f406800cd90 con 0x7f407010f1e0 2026-02-19T21:02:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.204+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c009590 con 0x7f407010f1e0 2026-02-19T21:02:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.204+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407015a160 con 0x7f407010f1e0 2026-02-19T21:02:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.206+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f40680028c0 con 0x7f407010f1e0 2026-02-19T21:02:43.209 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_use_global_snaprealm_seq_for_subvol', 'False'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.206+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40701104b0 con 0x7f407010f1e0 2026-02-19T21:02:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 -- 10.20.193.90:0/4222199332 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0060700 msgr2=0x7f22e0060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/4222199332 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0060700 0x7f22e0060ad0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=11792520423448424740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22d00098a0 tx=0x7f22d002ec60 comp rx=0 tx=0).stop 2026-02-19T21:02:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 -- 10.20.193.90:0/4222199332 shutdown_connections 2026-02-19T21:02:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/4222199332 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e0175a60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/4222199332 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f22e0061010 0x7f22e0155140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/4222199332 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0060700 0x7f22e0060ad0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=11792520423448424740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 -- 10.20.193.90:0/4222199332 >> 10.20.193.90:0/4222199332 conn(0x7f22e00ea870 msgr2=0x7f22e010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f405b7fe6c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f404c03f820 0x7f404c05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 -- 10.20.193.90:0/4222199332 shutdown_connections 2026-02-19T21:02:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4068051170 con 0x7f407010f1e0 2026-02-19T21:02:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f22e7f546c0 1 -- 10.20.193.90:0/4222199332 wait complete. 2026-02-19T21:02:43.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f4075da06c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f404c03f820 0x7f404c05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.207+0000 7f4075da06c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f404c03f820 0x7f404c05fcd0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4070113740 tx=0x7f405c0023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd23c03f870 msgr2=0x7fd23c05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd23c03f870 0x7fd23c05fd20 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd250005b40 tx=0x7fd2500023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 msgr2=0x7fd26011d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 0x7fd26011d770 secure :-1 s=READY pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd24800b650 tx=0x7fd24800bb20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 shutdown_connections 2026-02-19T21:02:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd23c03f870 0x7fd23c05fd20 unknown :-1 s=CLOSED pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd260122b30 0x7fd260122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd2601153f0 0x7fd26011d770 unknown :-1 s=CLOSED pgs=114 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 --2- 10.20.193.90:0/64084116 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd26010f1e0 0x7fd26011d230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 >> 10.20.193.90:0/64084116 conn(0x7fd2600ecaa0 msgr2=0x7fd26010ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 shutdown_connections 2026-02-19T21:02:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7fd2670f96c0 1 -- 10.20.193.90:0/64084116 wait complete. 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 Processor -- start 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 -- start start 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f22e0060700 0x7f22e0169e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0061010 0x7f22e016a3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e016f790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22e016fde0 con 0x7f22e0155680 2026-02-19T21:02:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22e016ff50 con 0x7f22e0061010 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.208+0000 7f22e7f546c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22e0170110 con 0x7f22e0060700 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e016f790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e016f790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38582/0 (socket says 10.20.193.90:38582) 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 -- 10.20.193.90:0/3446910504 learned_addr learned my addr 10.20.193.90:0/3446910504 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e5cc96c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f22e0060700 0x7f22e0169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e54c86c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0061010 0x7f22e016a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 -- 10.20.193.90:0/3446910504 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f22e0060700 msgr2=0x7f22e0169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f22e0060700 0x7f22e0169e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 -- 10.20.193.90:0/3446910504 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0061010 msgr2=0x7f22e016a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0061010 0x7f22e016a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 -- 10.20.193.90:0/3446910504 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d00094c0 con 0x7f22e0155680 2026-02-19T21:02:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.209+0000 7f22e64ca6c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e016f790 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22dc006a60 tx=0x7f22dc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/2045173267 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 msgr2=0x7fd3b0060b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/2045173267 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 0x7fd3b0060b30 secure :-1 s=READY pgs=13 gs=2 cs=0 l=1 c_cookie=5285961416919880606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3a4009970 tx=0x7fd3a402ed10 comp rx=0 tx=0).stop 2026-02-19T21:02:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/2045173267 shutdown_connections 2026-02-19T21:02:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/2045173267 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0155620 0x7fd3b0175a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/2045173267 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0061070 0x7fd3b01550e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/2045173267 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 0x7fd3b0060b30 unknown :-1 s=CLOSED pgs=13 gs=2 cs=0 l=1 c_cookie=5285961416919880606 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/2045173267 >> 10.20.193.90:0/2045173267 conn(0x7fd3b00ea870 msgr2=0x7fd3b010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/2045173267 shutdown_connections 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/2045173267 wait complete. 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22dc003c40 con 0x7f22e0155680 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f22dc00a030 con 0x7f22e0155680 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22dc00dd20 con 0x7f22e0155680 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e01703f0 con 0x7f22e0155680 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e0170ab0 con 0x7f22e0155680 2026-02-19T21:02:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.210+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f406800a040 con 0x7f407010f1e0 2026-02-19T21:02:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.211+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f22dc0081c0 con 0x7f22e0155680 2026-02-19T21:02:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.211+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e0170610 con 0x7f22e0155680 2026-02-19T21:02:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.211+0000 7fd3b4ad56c0 1 Processor -- start 2026-02-19T21:02:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.211+0000 7fd3b4ad56c0 1 -- start start 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3b4ad56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 0x7fd3b0161400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3b4ad56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0061070 0x7fd3b0161940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3b4ad56c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0155620 0x7fd3b0166d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3b4ad56c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0167350 con 0x7fd3b0061070 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3b4ad56c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b01674c0 con 0x7fd3b0155620 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3b4ad56c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b0167680 con 0x7fd3b0060760 2026-02-19T21:02:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7f22ceffd6c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22bc03f820 0x7f22bc05fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3aed766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0155620 0x7fd3b0166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3aed766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0155620 0x7fd3b0166d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:44598/0 (socket says 10.20.193.90:44598) 2026-02-19T21:02:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3aed766c0 1 -- 10.20.193.90:0/3865793755 learned_addr learned my addr 10.20.193.90:0/3865793755 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3add746c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0061070 0x7fd3b0161940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f22dc052210 con 0x7f22e0155680 2026-02-19T21:02:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7f22e5cc96c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22bc03f820 0x7f22bc05fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3add746c0 1 -- 10.20.193.90:0/3865793755 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 msgr2=0x7fd3b0161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3add746c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 0x7fd3b0161400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3add746c0 1 -- 10.20.193.90:0/3865793755 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0155620 msgr2=0x7fd3b0166d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3add746c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0155620 0x7fd3b0166d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7fd3add746c0 1 -- 10.20.193.90:0/3865793755 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a4009590 con 0x7fd3b0061070 2026-02-19T21:02:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.212+0000 7f22e5cc96c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22bc03f820 0x7f22bc05fcd0 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22d0005980 tx=0x7f22d0005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.213+0000 7fd3add746c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0061070 0x7fd3b0161940 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39800b640 tx=0x7fd39800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.214+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3980044a0 con 0x7fd3b0061070 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.214+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd398009030 con 0x7fd3b0061070 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.214+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd39800cbf0 con 0x7fd3b0061070 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.214+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b0167960 con 0x7fd3b0061070 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.214+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b0150a70 con 0x7fd3b0061070 2026-02-19T21:02:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.214+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22dc00e910 con 0x7f22e0155680 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.215+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b0167b80 con 0x7fd3b0061070 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.215+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fd3980026b0 con 0x7fd3b0061070 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.215+0000 7fd3977fe6c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd38803f820 0x7fd38805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.215+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fd398051160 con 0x7fd3b0061070 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.216+0000 7fd3ae5756c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd38803f820 0x7fd38805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.216+0000 7fd3ae5756c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd38803f820 0x7fd38805fcd0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3a40098c0 tx=0x7fd3a4005c20 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.219+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd3980055a0 con 0x7fd3b0061070 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: mgrmap e11: x(active, since 1.008s) 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial175", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:43.226 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1119199763' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2625114693' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3260520321' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1668589157' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2444388618' entity='client.admin' 2026-02-19T21:02:43.227 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.228 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.228 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.228 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.228 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1465368555' entity='client.admin' 2026-02-19T21:02:43.228 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.230 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 -- 10.20.193.90:0/389179417 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc115410 msgr2=0x7f9bbc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/389179417 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc115410 0x7f9bbc175db0 secure :-1 s=READY pgs=14 gs=3 cs=0 l=1 c_cookie=16383272727718767174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb800a9b0 tx=0x7f9bb802fd50 comp rx=0 tx=0).stop 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 -- 10.20.193.90:0/389179417 shutdown_connections 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/389179417 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc115410 0x7f9bbc175db0 unknown :-1 s=CLOSED pgs=14 gs=3 cs=0 l=1 c_cookie=16383272727718767174 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/389179417 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9bbc10fbf0 0x7f9bbc114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/389179417 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc10f200 0x7f9bbc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 -- 10.20.193.90:0/389179417 >> 10.20.193.90:0/389179417 conn(0x7f9bbc0ecac0 msgr2=0x7f9bbc10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 -- 10.20.193.90:0/389179417 shutdown_connections 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.234+0000 7f9bc39936c0 1 -- 10.20.193.90:0/389179417 wait complete. 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 Processor -- start 2026-02-19T21:02:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 -- start start 2026-02-19T21:02:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc10f200 0x7f9bbc0ed040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 0x7f9bbc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9bbc0ed670 0x7f9bbc0ef460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc0edd60 con 0x7f9bbc115410 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc0ef9a0 con 0x7f9bbc0ed670 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc39936c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9bbc0efb60 con 0x7f9bbc10f200 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 0x7f9bbc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 0x7f9bbc175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38608/0 (socket says 10.20.193.90:38608) 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 -- 10.20.193.90:0/3556587652 learned_addr learned my addr 10.20.193.90:0/3556587652 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc17046c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc10f200 0x7f9bbc0ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc1f056c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9bbc0ed670 0x7f9bbc0ef460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 -- 10.20.193.90:0/3556587652 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc10f200 msgr2=0x7f9bbc0ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc10f200 0x7f9bbc0ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 -- 10.20.193.90:0/3556587652 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9bbc0ed670 msgr2=0x7f9bbc0ef460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9bbc0ed670 0x7f9bbc0ef460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7f9bc0f036c0 1 -- 10.20.193.90:0/3556587652 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bac0094c0 con 0x7f9bbc115410 2026-02-19T21:02:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9bc0f036c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 0x7f9bbc175cb0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb0005930 tx=0x7f9bb000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3202455455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c410fbf0 msgr2=0x7fa8c4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3202455455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c410fbf0 0x7fa8c4114c30 secure :-1 s=READY pgs=128 gs=2 cs=0 l=1 c_cookie=15904828159689983706 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac0099a0 tx=0x7fa8ac037780 comp rx=0 tx=0).stop 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3202455455 shutdown_connections 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3202455455 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c4115410 0x7fa8c4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3202455455 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c410fbf0 0x7fa8c4114c30 unknown :-1 s=CLOSED pgs=128 gs=2 cs=0 l=1 c_cookie=15904828159689983706 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3202455455 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c410f200 0x7fa8c410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3202455455 >> 10.20.193.90:0/3202455455 conn(0x7fa8c40ecac0 msgr2=0x7fa8c410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3202455455 shutdown_connections 2026-02-19T21:02:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bb0004460 con 0x7f9bbc115410 2026-02-19T21:02:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb800a5b0 con 0x7f9bbc115410 2026-02-19T21:02:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bbc0f0190 con 0x7f9bbc115410 2026-02-19T21:02:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9bb00045c0 con 0x7f9bbc115410 2026-02-19T21:02:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bb0004460 con 0x7f9bbc115410 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3202455455 wait complete. 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 Processor -- start 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.235+0000 7fa8c96a76c0 1 -- start start 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c96a76c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c410f200 0x7fa8c40f42a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c96a76c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 0x7fa8c4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c96a76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c40f48d0 0x7fa8c40f9ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c96a76c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40f4fc0 con 0x7fa8c40f48d0 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c96a76c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40fa0e0 con 0x7fa8c410f200 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c96a76c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c40fa2a0 con 0x7fa8c4115410 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c27fc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 0x7fa8c4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c27fc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 0x7fa8c4175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:47086/0 (socket says 10.20.193.90:47086) 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c27fc6c0 1 -- 10.20.193.90:0/3342422792 learned_addr learned my addr 10.20.193.90:0/3342422792 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c37fe6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c40f48d0 0x7fa8c40f9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7fa8c2ffd6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c410f200 0x7fa8c40f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.236+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bbc1104d0 con 0x7f9bbc115410 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c27fc6c0 1 -- 10.20.193.90:0/3342422792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c410f200 msgr2=0x7fa8c40f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c27fc6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c410f200 0x7fa8c40f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c27fc6c0 1 -- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c40f48d0 msgr2=0x7fa8c40f9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c27fc6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c40f48d0 0x7fa8c40f9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c27fc6c0 1 -- 10.20.193.90:0/3342422792 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ac009590 con 0x7fa8c4115410 2026-02-19T21:02:43.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c2ffd6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c410f200 0x7fa8c40f42a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:02:43.243 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f9bb000cd00 con 0x7f9bbc115410 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7f9baa7fc6c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9b9803f880 0x7f9b9805fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f9bb0050d50 con 0x7f9bbc115410 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7f9bc17046c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9b9803f880 0x7f9b9805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.237+0000 7fa8c27fc6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 0x7fa8c4175cb0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac009aa0 tx=0x7fa8ac007900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.238+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ac005530 con 0x7fa8c4115410 2026-02-19T21:02:43.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.238+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa8ac005690 con 0x7fa8c4115410 2026-02-19T21:02:43.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.238+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa8ac004bf0 con 0x7fa8c4115410 2026-02-19T21:02:43.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.238+0000 7f9bc17046c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9b9803f880 0x7f9b9805fd30 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bac004750 tx=0x7f9bac009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.238+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c40fa520 con 0x7fa8c4115410 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.238+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c40fa950 con 0x7fa8c4115410 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.239+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c41104d0 con 0x7fa8c4115410 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.239+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7fa8ac0026b0 con 0x7fa8c4115410 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.239+0000 7fa8a3fff6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa89803f870 0x7fa89805fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.239+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa8ac07dce0 con 0x7fa8c4115410 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.239+0000 7fa8c2ffd6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa89803f870 0x7fa89805fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.240+0000 7fa8c2ffd6c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa89803f870 0x7fa89805fd20 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8b8004750 tx=0x7fa8b8009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.240+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9bb000a550 con 0x7f9bbc115410 2026-02-19T21:02:43.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.241+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa8ac039720 con 0x7fa8c4115410 2026-02-19T21:02:43.251 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.250+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f2ef811e410 con 0x7f2ef8115410 2026-02-19T21:02:43.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.253+0000 7f2ed7fff6c0 1 -- 10.20.193.90:0/1866970872 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v28)=0 v28) ==== 111+0+0 (secure 0 0 0) 0x7f2ee0015020 con 0x7f2ef8115410 2026-02-19T21:02:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ecc03f870 msgr2=0x7f2ecc05fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ecc03f870 0x7f2ecc05fd20 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2eec004750 tx=0x7f2eec009260 comp rx=0 tx=0).stop 2026-02-19T21:02:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 msgr2=0x7f2ef811d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef811d730 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ee000b800 tx=0x7f2ee000bcd0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 shutdown_connections 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ecc03f870 0x7f2ecc05fd20 unknown :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ef8122af0 0x7f2ef8122f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ef8115410 0x7f2ef811d730 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 --2- 10.20.193.90:0/1866970872 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ef810f200 0x7f2ef811d1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 >> 10.20.193.90:0/1866970872 conn(0x7f2ef80ecac0 msgr2=0x7f2ef810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 shutdown_connections 2026-02-19T21:02:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.257+0000 7f2efd7546c0 1 -- 10.20.193.90:0/1866970872 wait complete. 2026-02-19T21:02:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.264+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f8d2410f5d0 con 0x7f8d24115410 2026-02-19T21:02:43.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.264+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f88a0008f60 con 0x7f88a0101690 2026-02-19T21:02:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.267+0000 7f8d217fa6c0 1 -- 10.20.193.90:0/2607374746 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f8d14010de0 con 0x7f8d24115410 2026-02-19T21:02:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.267+0000 7f889dffb6c0 1 -- 10.20.193.90:0/3621939215 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v29)=0 v29) ==== 108+0+0 (secure 0 0 0) 0x7f8890035040 con 0x7f88a0101690 2026-02-19T21:02:43.271 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8cf803f820 msgr2=0x7f8cf805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.271 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8cf803f820 0x7f8cf805fcd0 secure :-1 s=READY pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d100097f0 tx=0x7f8d100023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.271 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 msgr2=0x7f8d24175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.271 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 0x7f8d24175cb0 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d14005b20 tx=0x7f8d1400bed0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.271 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 shutdown_connections 2026-02-19T21:02:43.271 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8cf803f820 0x7f8cf805fcd0 unknown :-1 s=CLOSED pgs=28 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8d240f9690 0x7f8d240fe960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8d24115410 0x7f8d24175cb0 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 --2- 10.20.193.90:0/2607374746 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8d2410f200 0x7f8d240f9060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 >> 10.20.193.90:0/2607374746 conn(0x7f8d240ecac0 msgr2=0x7f8d241131e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 shutdown_connections 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f8d2a42f6c0 1 -- 10.20.193.90:0/2607374746 wait complete. 2026-02-19T21:02:43.272 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f888403f820 msgr2=0x7f888405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f888403f820 0x7f888405fcd0 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8898004750 tx=0x7f8898009260 comp rx=0 tx=0).stop 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 msgr2=0x7f88a010b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 0x7f88a010b4e0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8890031fd0 tx=0x7f889002fc00 comp rx=0 tx=0).stop 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 shutdown_connections 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f888403f820 0x7f888405fcd0 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88a01108a0 0x7f88a0110d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88a0101690 0x7f88a010b4e0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 --2- 10.20.193.90:0/3621939215 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88a00095b0 0x7f88a010afa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 >> 10.20.193.90:0/3621939215 conn(0x7f88a00946c0 msgr2=0x7f88a00b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 shutdown_connections 2026-02-19T21:02:43.273 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.270+0000 7f88adcba6c0 1 -- 10.20.193.90:0/3621939215 wait complete. 2026-02-19T21:02:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/3436448006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4115410 msgr2=0x7f5bf4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/3436448006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4115410 0x7f5bf4175db0 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=1554974519181110219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bf000aa70 tx=0x7f5bf002fde0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/3436448006 shutdown_connections 2026-02-19T21:02:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/3436448006 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4115410 0x7f5bf4175db0 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=1554974519181110219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/3436448006 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5bf410fbf0 0x7f5bf4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/3436448006 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5bf410f200 0x7f5bf410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/3436448006 >> 10.20.193.90:0/3436448006 conn(0x7f5bf40ecac0 msgr2=0x7f5bf410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/3436448006 shutdown_connections 2026-02-19T21:02:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.274+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/3436448006 wait complete. 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 Processor -- start 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 -- start start 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5bf410f200 0x7f5bf411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5bf4115410 0x7f5bf411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 0x7f5bf4123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41235a0 con 0x7f5bf4122b90 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4123710 con 0x7f5bf410f200 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf41238d0 con 0x7f5bf4115410 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 0x7f5bf4123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 0x7f5bf4123030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38622/0 (socket says 10.20.193.90:38622) 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 -- 10.20.193.90:0/577455852 learned_addr learned my addr 10.20.193.90:0/577455852 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf901c6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5bf410f200 0x7f5bf411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 -- 10.20.193.90:0/577455852 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5bf4115410 msgr2=0x7f5bf411d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf881b6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5bf4115410 0x7f5bf411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5bf4115410 0x7f5bf411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 -- 10.20.193.90:0/577455852 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5bf410f200 msgr2=0x7f5bf411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5bf410f200 0x7f5bf411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 -- 10.20.193.90:0/577455852 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be80094c0 con 0x7f5bf4122b90 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bf981d6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 0x7f5bf4123030 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bf00054b0 tx=0x7f5bf00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bf0003c40 con 0x7f5bf4122b90 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5bf0003da0 con 0x7f5bf4122b90 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf000a660 con 0x7f5bf4122b90 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5bf00372d0 con 0x7f5bf4122b90 2026-02-19T21:02:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.275+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf4163fe0 con 0x7f5bf4122b90 2026-02-19T21:02:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.276+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f2c8c0fa0f0 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.276+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf41104d0 con 0x7f5bf4122b90 2026-02-19T21:02:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.276+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f5bf0008260 con 0x7f5bf4122b90 2026-02-19T21:02:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.277+0000 7f5be27fc6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5bd003f820 0x7f5bd005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.277+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5bf00764b0 con 0x7f5bf4122b90 2026-02-19T21:02:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.277+0000 7f5bf901c6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5bd003f820 0x7f5bd005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.277+0000 7f5bf901c6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5bd003f820 0x7f5bd005fcd0 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be4005fd0 tx=0x7f5be4009590 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.279+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5bf0032720 con 0x7f5bf4122b90 2026-02-19T21:02:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.280+0000 7f2c81ffb6c0 1 -- 10.20.193.90:0/60915168 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v30)=0 v30) ==== 115+0+0 (secure 0 0 0) 0x7f2c74016020 con 0x7f2c8c10cdb0 2026-02-19T21:02:43.285 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c5c03f880 msgr2=0x7f2c5c05fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.285 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c5c03f880 0x7f2c5c05fd30 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7c009260 tx=0x7f2c7c0023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.285 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 msgr2=0x7f2c8c0f8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.285 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c0f8fa0 secure :-1 s=READY pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c7400b710 tx=0x7f2c7400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.285 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 shutdown_connections 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c5c03f880 0x7f2c5c05fd30 unknown :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c8c0f95d0 0x7f2c8c0fe8a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c8c112fc0 0x7f2c8c173860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 --2- 10.20.193.90:0/60915168 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c8c10cdb0 0x7f2c8c0f8fa0 unknown :-1 s=CLOSED pgs=121 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 >> 10.20.193.90:0/60915168 conn(0x7f2c8c0ea690 msgr2=0x7f2c8c10b390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 shutdown_connections 2026-02-19T21:02:43.286 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.284+0000 7f2c919836c0 1 -- 10.20.193.90:0/60915168 wait complete. 2026-02-19T21:02:43.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.300+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f94c00ecde0 con 0x7f94c010b1f0 2026-02-19T21:02:43.304 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.303+0000 7f94ae7fc6c0 1 -- 10.20.193.90:0/1006299486 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f94b000de40 con 0x7f94c010b1f0 2026-02-19T21:02:43.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f949c03f820 msgr2=0x7f949c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f949c03f820 0x7f949c05fcd0 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94c00f2620 tx=0x7f94b4009260 comp rx=0 tx=0).stop 2026-02-19T21:02:43.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 msgr2=0x7f94c00ebc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 0x7f94c00ebc90 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b000b6c0 tx=0x7f94b000bb90 comp rx=0 tx=0).stop 2026-02-19T21:02:43.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 shutdown_connections 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f949c03f820 0x7f949c05fcd0 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94c0155910 0x7f94c00f1590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94c010bb00 0x7f94c00ec1d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 --2- 10.20.193.90:0/1006299486 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94c010b1f0 0x7f94c00ebc90 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 >> 10.20.193.90:0/1006299486 conn(0x7f94c0063a80 msgr2=0x7f94c0177e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 shutdown_connections 2026-02-19T21:02:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f94c77286c0 1 -- 10.20.193.90:0/1006299486 wait complete. 2026-02-19T21:02:43.311 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/2271948938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da410f200 msgr2=0x7f7da410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/2271948938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da410f200 0x7f7da410f5d0 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=7734791366125678849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d940099a0 tx=0x7f7d9402ed20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/2271948938 shutdown_connections 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/2271948938 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da4115410 0x7f7da4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/2271948938 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7da410fbf0 0x7f7da4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/2271948938 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da410f200 0x7f7da410f5d0 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=7734791366125678849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.307+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/2271948938 >> 10.20.193.90:0/2271948938 conn(0x7f7da40ecac0 msgr2=0x7f7da410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/2271948938 shutdown_connections 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/2271948938 wait complete. 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 Processor -- start 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 -- start start 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da410f200 0x7f7da411d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.312 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7da4115410 0x7f7da411d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.308+0000 7f7daab8b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 0x7f7da41230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7daab8b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7da4123630 con 0x7f7da4122c20 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 0x7f7da41230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 0x7f7da41230c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38640/0 (socket says 10.20.193.90:38640) 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 -- 10.20.193.90:0/3525030022 learned_addr learned my addr 10.20.193.90:0/3525030022 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7daab8b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7da41237a0 con 0x7f7da4115410 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7da4123960 con 0x7f7da410f200 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7d9bfff6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7da4115410 0x7f7da411d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 -- 10.20.193.90:0/3525030022 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da410f200 msgr2=0x7f7da411d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da88fc6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da410f200 0x7f7da411d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.313 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da410f200 0x7f7da411d320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 -- 10.20.193.90:0/3525030022 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7da4115410 msgr2=0x7f7da411d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7da4115410 0x7f7da411d860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 -- 10.20.193.90:0/3525030022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0094c0 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da88fc6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da410f200 0x7f7da411d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7da90fd6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 0x7f7da41230c0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da0006a60 tx=0x7f7da000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da0003c40 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7da000a070 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da000dde0 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.309+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d94009590 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.310+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da4164110 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.310+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da41104d0 con 0x7f7da4122c20 2026-02-19T21:02:43.314 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.310+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f7da0005030 con 0x7f7da4122c20 2026-02-19T21:02:43.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.311+0000 7f7d99ffb6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7d8003f820 0x7f7d8005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.311+0000 7f7da88fc6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7d8003f820 0x7f7d8005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.311+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f7da00520a0 con 0x7f7da4122c20 2026-02-19T21:02:43.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.311+0000 7f7da88fc6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7d8003f820 0x7f7d8005fcd0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d94009970 tx=0x7f7d940023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.313+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7da0010640 con 0x7f7da4122c20 2026-02-19T21:02:43.337 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.336+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f22e016afe0 con 0x7f22e0155680 2026-02-19T21:02:43.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.338+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f407017e610 con 0x7f407010f1e0 2026-02-19T21:02:43.340 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.338+0000 7f22ceffd6c0 1 -- 10.20.193.90:0/3446910504 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f22dc00e040 con 0x7f22e0155680 2026-02-19T21:02:43.342 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.341+0000 7f405b7fe6c0 1 -- 10.20.193.90:0/671516246 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f406800a040 con 0x7f407010f1e0 2026-02-19T21:02:43.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.341+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22bc03f820 msgr2=0x7f22bc05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.341+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22bc03f820 0x7f22bc05fcd0 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22d0005980 tx=0x7f22d0005910 comp rx=0 tx=0).stop 2026-02-19T21:02:43.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.341+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 msgr2=0x7f22e016f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.341+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e016f790 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22dc006a60 tx=0x7f22dc00ce50 comp rx=0 tx=0).stop 2026-02-19T21:02:43.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 shutdown_connections 2026-02-19T21:02:43.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22bc03f820 0x7f22bc05fcd0 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22e0155680 0x7f22e016f790 unknown :-1 s=CLOSED pgs=126 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f22e0061010 0x7f22e016a3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 --2- 10.20.193.90:0/3446910504 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f22e0060700 0x7f22e0169e90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 >> 10.20.193.90:0/3446910504 conn(0x7f22e00ea870 msgr2=0x7f22e010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 shutdown_connections 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.342+0000 7f22e7f546c0 1 -- 10.20.193.90:0/3446910504 wait complete. 2026-02-19T21:02:43.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.343+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd3b0061c70 con 0x7fd3b0061070 2026-02-19T21:02:43.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f404c03f820 msgr2=0x7f404c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f404c03f820 0x7f404c05fcd0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4070113740 tx=0x7f405c0023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 msgr2=0x7f407017d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 0x7f407017d4c0 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f406800b710 tx=0x7f406800bbe0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 shutdown_connections 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f404c03f820 0x7f404c05fcd0 unknown :-1 s=CLOSED pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4070118d00 0x7f40701191a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f40701153f0 0x7f407017da00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 --2- 10.20.193.90:0/671516246 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f407010f1e0 0x7f407017d4c0 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 >> 10.20.193.90:0/671516246 conn(0x7f40700ecaa0 msgr2=0x7f407010ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 shutdown_connections 2026-02-19T21:02:43.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.344+0000 7f40788306c0 1 -- 10.20.193.90:0/671516246 wait complete. 2026-02-19T21:02:43.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.345+0000 7fd3977fe6c0 1 -- 10.20.193.90:0/3865793755 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v34)=0 v34) ==== 120+0+0 (secure 0 0 0) 0x7fd398008e60 con 0x7fd3b0061070 2026-02-19T21:02:43.349 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd38803f820 msgr2=0x7fd38805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd38803f820 0x7fd38805fcd0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3a40098c0 tx=0x7fd3a4005c20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0061070 msgr2=0x7fd3b0161940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0061070 0x7fd3b0161940 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd39800b640 tx=0x7fd39800bb10 comp rx=0 tx=0).stop 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 shutdown_connections 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd38803f820 0x7fd38805fcd0 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd3b0155620 0x7fd3b0166d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd3b0061070 0x7fd3b0161940 unknown :-1 s=CLOSED pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 --2- 10.20.193.90:0/3865793755 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd3b0060760 0x7fd3b0161400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 >> 10.20.193.90:0/3865793755 conn(0x7fd3b00ea870 msgr2=0x7fd3b010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.350 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 shutdown_connections 2026-02-19T21:02:43.351 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.348+0000 7fd3b4ad56c0 1 -- 10.20.193.90:0/3865793755 wait complete. 2026-02-19T21:02:43.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.361+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f9bbc0edf10 con 0x7f9bbc115410 2026-02-19T21:02:43.365 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.364+0000 7f9baa7fc6c0 1 -- 10.20.193.90:0/3556587652 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v35)=0 v35) ==== 121+0+0 (secure 0 0 0) 0x7f9bb000a550 con 0x7f9bbc115410 2026-02-19T21:02:43.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.365+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fa8c40f53f0 con 0x7fa8c4115410 2026-02-19T21:02:43.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9b9803f880 msgr2=0x7f9b9805fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9b9803f880 0x7f9b9805fd30 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bac004750 tx=0x7f9bac009260 comp rx=0 tx=0).stop 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 msgr2=0x7f9bbc175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 0x7f9bbc175cb0 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bb0005930 tx=0x7f9bb000bca0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 shutdown_connections 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9b9803f880 0x7f9b9805fd30 unknown :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9bbc0ed670 0x7f9bbc0ef460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9bbc115410 0x7f9bbc175cb0 unknown :-1 s=CLOSED pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 --2- 10.20.193.90:0/3556587652 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9bbc10f200 0x7f9bbc0ed040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 >> 10.20.193.90:0/3556587652 conn(0x7f9bbc0ecac0 msgr2=0x7f9bbc110d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 shutdown_connections 2026-02-19T21:02:43.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.367+0000 7f9bc39936c0 1 -- 10.20.193.90:0/3556587652 wait complete. 2026-02-19T21:02:43.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.368+0000 7fa8a3fff6c0 1 -- 10.20.193.90:0/3342422792 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v36)=0 v36) ==== 129+0+0 (secure 0 0 0) 0x7fa8ac039030 con 0x7fa8c4115410 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa89803f870 msgr2=0x7fa89805fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa89803f870 0x7fa89805fd20 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8b8004750 tx=0x7fa8b8009260 comp rx=0 tx=0).stop 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 msgr2=0x7fa8c4175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 0x7fa8c4175cb0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8ac009aa0 tx=0x7fa8ac007900 comp rx=0 tx=0).stop 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 shutdown_connections 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa89803f870 0x7fa89805fd20 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa8c40f48d0 0x7fa8c40f9ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa8c4115410 0x7fa8c4175cb0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 --2- 10.20.193.90:0/3342422792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa8c410f200 0x7fa8c40f42a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 >> 10.20.193.90:0/3342422792 conn(0x7fa8c40ecac0 msgr2=0x7fa8c410df10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 shutdown_connections 2026-02-19T21:02:43.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.371+0000 7fa8c96a76c0 1 -- 10.20.193.90:0/3342422792 wait complete. 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: mgrmap e11: x(active, since 1.008s) 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial175", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial105", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial090", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1119199763' entity='client.admin' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2625114693' entity='client.admin' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3260520321' entity='client.admin' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1668589157' entity='client.admin' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2444388618' entity='client.admin' 2026-02-19T21:02:43.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:43.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1465368555' entity='client.admin' 2026-02-19T21:02:43.399 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.395+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f5bf411e3e0 con 0x7f5bf4122b90 2026-02-19T21:02:43.399 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.395+0000 7f5be27fc6c0 1 -- 10.20.193.90:0/577455852 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v36)=0 v36) ==== 106+0+0 (secure 0 0 0) 0x7f5bf0032030 con 0x7f5bf4122b90 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5bd003f820 msgr2=0x7f5bd005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5bd003f820 0x7f5bd005fcd0 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5be4005fd0 tx=0x7f5be4009590 comp rx=0 tx=0).stop 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 msgr2=0x7f5bf4123030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 0x7f5bf4123030 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5bf00054b0 tx=0x7f5bf00054e0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 shutdown_connections 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5bd003f820 0x7f5bd005fcd0 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5bf4122b90 0x7f5bf4123030 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.401 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5bf4115410 0x7f5bf411d7d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.402 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 --2- 10.20.193.90:0/577455852 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5bf410f200 0x7f5bf411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.402 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 >> 10.20.193.90:0/577455852 conn(0x7f5bf40ecac0 msgr2=0x7f5bf410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.402 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 shutdown_connections 2026-02-19T21:02:43.402 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.398+0000 7f5bfb2ab6c0 1 -- 10.20.193.90:0/577455852 wait complete. 2026-02-19T21:02:43.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.420 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.420+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f7da411e4d0 con 0x7f7da4122c20 2026-02-19T21:02:43.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.422+0000 7f7d99ffb6c0 1 -- 10.20.193.90:0/3525030022 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v37)=0 v37) ==== 138+0+0 (secure 0 0 0) 0x7f7da0010640 con 0x7f7da4122c20 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7d8003f820 msgr2=0x7f7d8005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7d8003f820 0x7f7d8005fcd0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d94009970 tx=0x7f7d940023a0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 msgr2=0x7f7da41230c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 0x7f7da41230c0 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da0006a60 tx=0x7f7da000cca0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 shutdown_connections 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7d8003f820 0x7f7d8005fcd0 unknown :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7da4122c20 0x7f7da41230c0 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7da4115410 0x7f7da411d860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 --2- 10.20.193.90:0/3525030022 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7da410f200 0x7f7da411d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 >> 10.20.193.90:0/3525030022 conn(0x7f7da40ecac0 msgr2=0x7f7da410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 shutdown_connections 2026-02-19T21:02:43.426 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.425+0000 7f7daab8b6c0 1 -- 10.20.193.90:0/3525030022 wait complete. 2026-02-19T21:02:43.441 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.462 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.462 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.462 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.462 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.463 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '34db945f-0dd6-11f1-890f-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial090') 2026-02-19T21:02:43.463 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config dump 2026-02-19T21:02:43.539 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.537+0000 7f4d8190dfc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-19T21:02:43.624 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/296261940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10d960 msgr2=0x7f4fcc1129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/296261940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10d960 0x7f4fcc1129a0 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=3360862383563456116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc00099a0 tx=0x7f4fc002ed20 comp rx=0 tx=0).stop 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/296261940 shutdown_connections 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/296261940 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4fcc113180 0x7f4fcc173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/296261940 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10d960 0x7f4fcc1129a0 unknown :-1 s=CLOSED pgs=134 gs=1 cs=0 l=1 c_cookie=3360862383563456116 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/296261940 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc10d340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/296261940 >> 10.20.193.90:0/296261940 conn(0x7f4fcc0ea870 msgr2=0x7f4fcc10ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/296261940 shutdown_connections 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/296261940 wait complete. 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 Processor -- start 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- start start 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc11b9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4fcc113180 0x7f4fcc11bef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4fcc1212b0 0x7f4fcc121750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc121cc0 con 0x7f4fcc10cf70 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc121e30 con 0x7f4fcc1212b0 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd342c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4fcc121ff0 con 0x7f4fcc113180 2026-02-19T21:02:43.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc11b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc11b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:38662/0 (socket says 10.20.193.90:38662) 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 -- 10.20.193.90:0/2253464324 learned_addr learned my addr 10.20.193.90:0/2253464324 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd099c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4fcc113180 0x7f4fcc11bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd199e6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4fcc1212b0 0x7f4fcc121750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 -- 10.20.193.90:0/2253464324 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4fcc113180 msgr2=0x7f4fcc11bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4fcc113180 0x7f4fcc11bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 -- 10.20.193.90:0/2253464324 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4fcc1212b0 msgr2=0x7f4fcc121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4fcc1212b0 0x7f4fcc121750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.744+0000 7f4fd119d6c0 1 -- 10.20.193.90:0/2253464324 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc0009590 con 0x7f4fcc10cf70 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fd119d6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc11b9b0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fbc00b710 tx=0x7f4fbc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fbc004250 con 0x7f4fcc10cf70 2026-02-19T21:02:43.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4fbc002d80 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fcc1624a0 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4fbc00cdc0 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fcc162980 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fcc10e240 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.745+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f4fbc0028c0 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.746+0000 7f4fba7fc6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4fa803f820 0x7f4fa805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.746+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4fbc0512c0 con 0x7f4fcc10cf70 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.746+0000 7f4fd099c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4fa803f820 0x7f4fa805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:43.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.746+0000 7f4fd099c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4fa803f820 0x7f4fa805fcd0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc0005b40 tx=0x7f4fc0005c40 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:43.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.748+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4fbc00a040 con 0x7f4fcc10cf70 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.739+0000 7f4d8190dfc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.741+0000 7f4d8190dfc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.765+0000 7f4d8190dfc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.772+0000 7f4d8190dfc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.774+0000 7f4d8190dfc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.777+0000 7f4d8190dfc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.778+0000 7f4d8190dfc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.780+0000 7f4d8190dfc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-19T21:02:43.812 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.782+0000 7f4d8190dfc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-19T21:02:43.813 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.811+0000 7f4d8190dfc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-19T21:02:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.837+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4fcc10d340 con 0x7f4fcc10cf70 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.837+0000 7f4fba7fc6c0 1 -- 10.20.193.90:0/2253464324 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+20114 (secure 0 0 0) 0x7f4fbc016a10 con 0x7f4fcc10cf70 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global dev auth_debug true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 * 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global dev debug_asserts_on_shutdown true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global basic log_to_file true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global basic log_to_journald false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global basic log_to_stderr false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_allow_pool_delete true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_cluster_log_to_file true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global dev ms_die_on_bug true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global dev ms_die_on_old_message true 2026-02-19T21:02:43.838 INFO:teuthology.orchestra.run.trial090.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced debug_mon 20/20 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced debug_ms 1/1 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced debug_paxos 20/20 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_data_avail_warn 5 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_op_complaint_time 120 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced client_mount_timeout 30 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced debug_cephsqlite 20/20 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced debug_client 20/20 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced debug_mgr 20/20 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced debug_ms 1/1 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mgr/snap_schedule/log_level debug 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced bdev_async_discard true 2026-02-19T21:02:43.839 INFO:teuthology.orchestra.run.trial090.stdout:osd dev bdev_debug_aio true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced bdev_enable_discard true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced bluestore_allocator bitmap * 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev bluestore_fsck_on_mount true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced debug_bluefs 1/20 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced debug_bluestore 1/20 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced debug_ms 1/1 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced debug_osd 20/20 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced debug_rocksdb 4/10 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_misdirected_ops true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_op_order true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_shutdown true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_max_omap_entries_per_request 10 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_memory_target_autotune true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_objectstore bluestore * 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_op_queue debug_random * 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_recover_clone_overlap true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced debug_mds 20/20 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced debug_mds_balancer 20/20 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced debug_ms 2/2 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_bal_merge_size 5 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_bal_split_bits 3 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_bal_split_size 100 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds dev mds_debug_frag true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds dev mds_debug_scatterstat true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced mds_use_global_snaprealm_seq_for_subvol false 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds dev mds_verify_scatter true 2026-02-19T21:02:43.840 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced rados_mon_op_timeout 900 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:mds advanced rados_osd_op_timeout 900 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client advanced client_mount_timeout 600 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client advanced debug_client 20/20 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client advanced debug_ms 1/1 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client advanced rados_mon_op_timeout 900 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client advanced rados_osd_op_timeout 900 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4fa803f820 msgr2=0x7f4fa805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4fa803f820 0x7f4fa805fcd0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc0005b40 tx=0x7f4fc0005c40 comp rx=0 tx=0).stop 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 msgr2=0x7f4fcc11b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc11b9b0 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fbc00b710 tx=0x7f4fbc00bbe0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 shutdown_connections 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4fa803f820 0x7f4fa805fcd0 unknown :-1 s=CLOSED pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4fcc1212b0 0x7f4fcc121750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4fcc113180 0x7f4fcc11bef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 --2- 10.20.193.90:0/2253464324 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4fcc10cf70 0x7f4fcc11b9b0 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 >> 10.20.193.90:0/2253464324 conn(0x7f4fcc0ea870 msgr2=0x7f4fcc10ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 shutdown_connections 2026-02-19T21:02:43.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:43.838+0000 7f4fd342c6c0 1 -- 10.20.193.90:0/2253464324 wait complete. 2026-02-19T21:02:43.874 INFO:tasks.cephadm:Deploying OSDs... 2026-02-19T21:02:43.875 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:02:43.875 DEBUG:teuthology.orchestra.run.trial090:> dd if=/scratch_devs of=/dev/stdout 2026-02-19T21:02:43.892 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-19T21:02:43.892 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_1 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout:Device: 0,6 Inode: 884 Links: 1 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-19 21:02:17.025457353 +0000 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-19 21:00:50.599546639 +0000 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-19 21:00:50.599546639 +0000 2026-02-19T21:02:43.950 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-19 21:00:50.599546639 +0000 2026-02-19T21:02:43.950 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-19T21:02:44.016 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-19T21:02:44.016 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-19T21:02:44.017 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000138617 s, 3.7 MB/s 2026-02-19T21:02:44.018 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-19T21:02:44.075 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_2 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.823+0000 7f4d8190dfc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.832+0000 7f4d8190dfc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.836+0000 7f4d8190dfc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.839+0000 7f4d8190dfc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.840+0000 7f4d8190dfc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.841+0000 7f4d8190dfc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.973+0000 7f4d8190dfc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.976+0000 7f4d8190dfc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-19T21:02:44.127 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.984+0000 7f4d8190dfc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-19T21:02:44.128 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.986+0000 7f4d8190dfc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-19T21:02:44.128 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.987+0000 7f4d8190dfc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-19T21:02:44.128 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:43.990+0000 7f4d8190dfc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-19T21:02:44.134 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-19T21:02:44.134 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:44.134 INFO:teuthology.orchestra.run.trial090.stdout:Device: 0,6 Inode: 894 Links: 1 2026-02-19T21:02:44.135 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:44.135 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:44.135 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-19 21:02:17.025457353 +0000 2026-02-19T21:02:44.135 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-19 21:00:50.892541276 +0000 2026-02-19T21:02:44.135 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-19 21:00:50.892541276 +0000 2026-02-19T21:02:44.135 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-19 21:00:50.892541276 +0000 2026-02-19T21:02:44.135 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-19T21:02:44.201 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-19T21:02:44.201 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-19T21:02:44.201 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000138336 s, 3.7 MB/s 2026-02-19T21:02:44.202 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-19T21:02:44.258 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: Optimize plan auto_2026-02-19_21:02:41, mode upmap, max misplaced 0.050000 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: No pools available 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial090=x;trial105=y;trial175=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3093284459' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/836617357' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/64084116' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1866970872' entity='client.admin' 2026-02-19T21:02:44.259 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2607374746' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/60915168' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1006299486' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3446910504' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/671516246' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3865793755' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3556587652' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3525030022' entity='client.admin' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.260 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2253464324' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:44 trial105 ceph-mon[33883]: mgrmap e12: x(active, since 2s) 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.164+0000 7f5d58afdfc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-19T21:02:44.261 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.257+0000 7f5d58afdfc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-19T21:02:44.262 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_3 2026-02-19T21:02:44.320 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout:Device: 0,6 Inode: 907 Links: 1 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-19 21:02:17.025457353 +0000 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-19 21:00:51.206535529 +0000 2026-02-19T21:02:44.321 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-19 21:00:51.206535529 +0000 2026-02-19T21:02:44.322 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-19 21:00:51.206535529 +0000 2026-02-19T21:02:44.322 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-19T21:02:44.384 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: Optimize plan auto_2026-02-19_21:02:41, mode upmap, max misplaced 0.050000 2026-02-19T21:02:44.384 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: No pools available 2026-02-19T21:02:44.384 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial090=x;trial105=y;trial175=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3093284459' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/836617357' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/64084116' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1866970872' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2607374746' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/60915168' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1006299486' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3446910504' entity='client.admin' 2026-02-19T21:02:44.385 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/671516246' entity='client.admin' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3865793755' entity='client.admin' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3556587652' entity='client.admin' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3525030022' entity='client.admin' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2253464324' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-19T21:02:44.386 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:44 trial090 ceph-mon[31759]: mgrmap e12: x(active, since 2s) 2026-02-19T21:02:44.388 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-19T21:02:44.388 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-19T21:02:44.388 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.000138938 s, 3.7 MB/s 2026-02-19T21:02:44.388 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-19T21:02:44.447 DEBUG:teuthology.orchestra.run.trial090:> stat /dev/vg_nvme/lv_4 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.132+0000 7f4d8190dfc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.141+0000 7f4d8190dfc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.147+0000 7f4d8190dfc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.150+0000 7f4d8190dfc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.189+0000 7f4d8190dfc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.218+0000 7f4d8190dfc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.224+0000 7f4d8190dfc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-19T21:02:44.449 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.225+0000 7f4d8190dfc0 -1 mgr[py] Loading module status in main interpreter 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mgr.z.trial175.stdout:Feb 19 21:02:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-z[36625]: 2026-02-19T21:02:44.226+0000 7f4d8190dfc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: Optimize plan auto_2026-02-19_21:02:41, mode upmap, max misplaced 0.050000 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: No pools available 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial090=x;trial105=y;trial175=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3093284459' entity='client.admin' 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/836617357' entity='client.admin' 2026-02-19T21:02:44.450 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/64084116' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1866970872' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2607374746' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/60915168' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1006299486' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3446910504' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/671516246' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3865793755' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3556587652' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? ' entity='client.admin' 2026-02-19T21:02:44.451 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3525030022' entity='client.admin' 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2253464324' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-19T21:02:44.452 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:44 trial175 ceph-mon[34116]: mgrmap e12: x(active, since 2s) 2026-02-19T21:02:44.505 INFO:teuthology.orchestra.run.trial090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout:Device: 0,6 Inode: 918 Links: 1 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout:Access: 2026-02-19 21:02:17.025457353 +0000 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout:Modify: 2026-02-19 21:00:51.506530039 +0000 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout:Change: 2026-02-19 21:00:51.506530039 +0000 2026-02-19T21:02:44.506 INFO:teuthology.orchestra.run.trial090.stdout: Birth: 2026-02-19 21:00:51.506530039 +0000 2026-02-19T21:02:44.507 DEBUG:teuthology.orchestra.run.trial090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-19T21:02:44.511 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.463+0000 7f5d58afdfc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-19T21:02:44.511 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.464+0000 7f5d58afdfc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.489+0000 7f5d58afdfc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.495+0000 7f5d58afdfc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.498+0000 7f5d58afdfc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.501+0000 7f5d58afdfc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.502+0000 7f5d58afdfc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.504+0000 7f5d58afdfc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-19T21:02:44.512 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.506+0000 7f5d58afdfc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-19T21:02:44.571 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records in 2026-02-19T21:02:44.572 INFO:teuthology.orchestra.run.trial090.stderr:1+0 records out 2026-02-19T21:02:44.572 INFO:teuthology.orchestra.run.trial090.stderr:512 bytes copied, 0.00014568 s, 3.5 MB/s 2026-02-19T21:02:44.573 DEBUG:teuthology.orchestra.run.trial090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-19T21:02:44.632 DEBUG:teuthology.orchestra.run.trial105:> set -ex 2026-02-19T21:02:44.632 DEBUG:teuthology.orchestra.run.trial105:> dd if=/scratch_devs of=/dev/stdout 2026-02-19T21:02:44.649 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-19T21:02:44.650 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_1 2026-02-19T21:02:44.708 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-19T21:02:44.708 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:44.708 INFO:teuthology.orchestra.run.trial105.stdout:Device: 0,6 Inode: 883 Links: 1 2026-02-19T21:02:44.709 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:44.709 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:44.709 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-19 21:02:43.981772446 +0000 2026-02-19T21:02:44.709 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-19 21:00:49.435838765 +0000 2026-02-19T21:02:44.709 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-19 21:00:49.435838765 +0000 2026-02-19T21:02:44.709 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-19 21:00:49.435838765 +0000 2026-02-19T21:02:44.709 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.536+0000 7f5d58afdfc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.549+0000 7f5d58afdfc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.559+0000 7f5d58afdfc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.563+0000 7f5d58afdfc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.566+0000 7f5d58afdfc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.567+0000 7f5d58afdfc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.568+0000 7f5d58afdfc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.701+0000 7f5d58afdfc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.704+0000 7f5d58afdfc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.712+0000 7f5d58afdfc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.714+0000 7f5d58afdfc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.716+0000 7f5d58afdfc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-19T21:02:44.774 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.718+0000 7f5d58afdfc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-19T21:02:44.777 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-19T21:02:44.777 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-19T21:02:44.777 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000134668 s, 3.8 MB/s 2026-02-19T21:02:44.778 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-19T21:02:44.836 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_2 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout:Device: 0,6 Inode: 896 Links: 1 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-19 21:02:43.981772446 +0000 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-19 21:00:49.733819918 +0000 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-19 21:00:49.733819918 +0000 2026-02-19T21:02:44.893 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-19 21:00:49.733819918 +0000 2026-02-19T21:02:44.893 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-19T21:02:44.958 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-19T21:02:44.958 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-19T21:02:44.958 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000133055 s, 3.8 MB/s 2026-02-19T21:02:44.960 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-19T21:02:45.017 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_3 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout:Device: 0,6 Inode: 906 Links: 1 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-19 21:02:43.981772446 +0000 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-19 21:00:50.038800627 +0000 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-19 21:00:50.038800627 +0000 2026-02-19T21:02:45.075 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-19 21:00:50.038800627 +0000 2026-02-19T21:02:45.075 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-19T21:02:45.138 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.864+0000 7f5d58afdfc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-19T21:02:45.138 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.873+0000 7f5d58afdfc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-19T21:02:45.138 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.880+0000 7f5d58afdfc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-19T21:02:45.138 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.883+0000 7f5d58afdfc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-19T21:02:45.139 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.921+0000 7f5d58afdfc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-19T21:02:45.139 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.950+0000 7f5d58afdfc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-19T21:02:45.139 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.956+0000 7f5d58afdfc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-19T21:02:45.139 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.957+0000 7f5d58afdfc0 -1 mgr[py] Loading module status in main interpreter 2026-02-19T21:02:45.139 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:02:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-y[36021]: 2026-02-19T21:02:44.958+0000 7f5d58afdfc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-19T21:02:45.140 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-19T21:02:45.140 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-19T21:02:45.140 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000223962 s, 2.3 MB/s 2026-02-19T21:02:45.142 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-19T21:02:45.201 DEBUG:teuthology.orchestra.run.trial105:> stat /dev/vg_nvme/lv_4 2026-02-19T21:02:45.259 INFO:teuthology.orchestra.run.trial105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-19T21:02:45.259 INFO:teuthology.orchestra.run.trial105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:45.259 INFO:teuthology.orchestra.run.trial105.stdout:Device: 0,6 Inode: 918 Links: 1 2026-02-19T21:02:45.260 INFO:teuthology.orchestra.run.trial105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:45.260 INFO:teuthology.orchestra.run.trial105.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:45.260 INFO:teuthology.orchestra.run.trial105.stdout:Access: 2026-02-19 21:02:43.982772389 +0000 2026-02-19T21:02:45.260 INFO:teuthology.orchestra.run.trial105.stdout:Modify: 2026-02-19 21:00:50.323782602 +0000 2026-02-19T21:02:45.260 INFO:teuthology.orchestra.run.trial105.stdout:Change: 2026-02-19 21:00:50.323782602 +0000 2026-02-19T21:02:45.260 INFO:teuthology.orchestra.run.trial105.stdout: Birth: 2026-02-19 21:00:50.323782602 +0000 2026-02-19T21:02:45.260 DEBUG:teuthology.orchestra.run.trial105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-19T21:02:45.326 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records in 2026-02-19T21:02:45.326 INFO:teuthology.orchestra.run.trial105.stderr:1+0 records out 2026-02-19T21:02:45.326 INFO:teuthology.orchestra.run.trial105.stderr:512 bytes copied, 0.000196842 s, 2.6 MB/s 2026-02-19T21:02:45.327 DEBUG:teuthology.orchestra.run.trial105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-19T21:02:45.386 DEBUG:teuthology.orchestra.run.trial175:> set -ex 2026-02-19T21:02:45.387 DEBUG:teuthology.orchestra.run.trial175:> dd if=/scratch_devs of=/dev/stdout 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: Standby manager daemon z started 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: Standby manager daemon y started 2026-02-19T21:02:45.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:45.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:45.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.406 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-19T21:02:45.406 DEBUG:teuthology.orchestra.run.trial175:> stat /dev/vg_nvme/lv_1 2026-02-19T21:02:45.465 INFO:teuthology.orchestra.run.trial175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout:Device: 0,6 Inode: 880 Links: 1 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout:Access: 2026-02-19 21:02:43.248384128 +0000 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout:Modify: 2026-02-19 21:00:50.826654980 +0000 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout:Change: 2026-02-19 21:00:50.826654980 +0000 2026-02-19T21:02:45.466 INFO:teuthology.orchestra.run.trial175.stdout: Birth: 2026-02-19 21:00:50.826654980 +0000 2026-02-19T21:02:45.467 DEBUG:teuthology.orchestra.run.trial175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-19T21:02:45.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: Standby manager daemon z started 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: Standby manager daemon y started 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.534 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records in 2026-02-19T21:02:45.534 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records out 2026-02-19T21:02:45.534 INFO:teuthology.orchestra.run.trial175.stderr:512 bytes copied, 0.000136985 s, 3.7 MB/s 2026-02-19T21:02:45.535 DEBUG:teuthology.orchestra.run.trial175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-19T21:02:45.594 DEBUG:teuthology.orchestra.run.trial175:> stat /dev/vg_nvme/lv_2 2026-02-19T21:02:45.652 INFO:teuthology.orchestra.run.trial175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout:Device: 0,6 Inode: 893 Links: 1 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout:Access: 2026-02-19 21:02:43.249384109 +0000 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout:Modify: 2026-02-19 21:00:51.096648589 +0000 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout:Change: 2026-02-19 21:00:51.096648589 +0000 2026-02-19T21:02:45.653 INFO:teuthology.orchestra.run.trial175.stdout: Birth: 2026-02-19 21:00:51.096648589 +0000 2026-02-19T21:02:45.653 DEBUG:teuthology.orchestra.run.trial175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-19T21:02:45.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: Standby manager daemon z started 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-19T21:02:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: Standby manager daemon y started 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:45.717 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records in 2026-02-19T21:02:45.718 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records out 2026-02-19T21:02:45.718 INFO:teuthology.orchestra.run.trial175.stderr:512 bytes copied, 0.000127467 s, 4.0 MB/s 2026-02-19T21:02:45.719 DEBUG:teuthology.orchestra.run.trial175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-19T21:02:45.777 DEBUG:teuthology.orchestra.run.trial175:> stat /dev/vg_nvme/lv_3 2026-02-19T21:02:45.835 INFO:teuthology.orchestra.run.trial175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-19T21:02:45.835 INFO:teuthology.orchestra.run.trial175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:45.835 INFO:teuthology.orchestra.run.trial175.stdout:Device: 0,6 Inode: 901 Links: 1 2026-02-19T21:02:45.836 INFO:teuthology.orchestra.run.trial175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:45.836 INFO:teuthology.orchestra.run.trial175.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:45.836 INFO:teuthology.orchestra.run.trial175.stdout:Access: 2026-02-19 21:02:43.249384109 +0000 2026-02-19T21:02:45.836 INFO:teuthology.orchestra.run.trial175.stdout:Modify: 2026-02-19 21:00:51.364642245 +0000 2026-02-19T21:02:45.836 INFO:teuthology.orchestra.run.trial175.stdout:Change: 2026-02-19 21:00:51.364642245 +0000 2026-02-19T21:02:45.836 INFO:teuthology.orchestra.run.trial175.stdout: Birth: 2026-02-19 21:00:51.364642245 +0000 2026-02-19T21:02:45.836 DEBUG:teuthology.orchestra.run.trial175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-19T21:02:45.901 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records in 2026-02-19T21:02:45.902 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records out 2026-02-19T21:02:45.902 INFO:teuthology.orchestra.run.trial175.stderr:512 bytes copied, 0.00020914 s, 2.4 MB/s 2026-02-19T21:02:45.903 DEBUG:teuthology.orchestra.run.trial175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-19T21:02:45.962 DEBUG:teuthology.orchestra.run.trial175:> stat /dev/vg_nvme/lv_4 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout:Device: 0,6 Inode: 913 Links: 1 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout:Context: system_u:object_r:device_t:s0 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout:Access: 2026-02-19 21:02:43.249384109 +0000 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout:Modify: 2026-02-19 21:00:51.669635025 +0000 2026-02-19T21:02:46.021 INFO:teuthology.orchestra.run.trial175.stdout:Change: 2026-02-19 21:00:51.669635025 +0000 2026-02-19T21:02:46.022 INFO:teuthology.orchestra.run.trial175.stdout: Birth: 2026-02-19 21:00:51.669635025 +0000 2026-02-19T21:02:46.022 DEBUG:teuthology.orchestra.run.trial175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-19T21:02:46.086 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records in 2026-02-19T21:02:46.087 INFO:teuthology.orchestra.run.trial175.stderr:1+0 records out 2026-02-19T21:02:46.087 INFO:teuthology.orchestra.run.trial175.stderr:512 bytes copied, 0.000196656 s, 2.6 MB/s 2026-02-19T21:02:46.088 DEBUG:teuthology.orchestra.run.trial175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-19T21:02:46.146 INFO:tasks.cephadm:Deploying osd.0 on trial090 with /dev/vg_nvme/lv_4... 2026-02-19T21:02:46.146 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-19T21:02:46.274 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:46.478 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:46 trial090 ceph-mon[31759]: mgrmap e13: x(active, since 4s), standbys: z, y 2026-02-19T21:02:46.478 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:46 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-19T21:02:46.479 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:46 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-19T21:02:46.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:46 trial175 ceph-mon[34116]: mgrmap e13: x(active, since 4s), standbys: z, y 2026-02-19T21:02:46.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:46 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-19T21:02:46.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:46 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-19T21:02:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:46 trial105 ceph-mon[33883]: mgrmap e13: x(active, since 4s), standbys: z, y 2026-02-19T21:02:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:46 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-19T21:02:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:46 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-19T21:02:46.693 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:02:46.709 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_4 --skip-validation 2026-02-19T21:02:46.833 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/1080704675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410d960 msgr2=0x7f12441129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/1080704675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410d960 0x7f12441129a0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=17228971694894766430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12340099a0 tx=0x7f123402ed20 comp rx=0 tx=0).stop 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/1080704675 shutdown_connections 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/1080704675 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1244113180 0x7f1244173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/1080704675 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410d960 0x7f12441129a0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=17228971694894766430 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/1080704675 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f124410cf70 0x7f124410d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:46.958 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/1080704675 >> 10.20.193.90:0/1080704675 conn(0x7f12440ea870 msgr2=0x7f124410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/1080704675 shutdown_connections 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/1080704675 wait complete. 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 Processor -- start 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.954+0000 7f1249e8c6c0 1 -- start start 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 0x7f12440f4c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1244113180 0x7f1244173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f12440f52b0 0x7f12440fa580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12440f59a0 con 0x7f124410cf70 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12440faac0 con 0x7f1244113180 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12440fac80 con 0x7f12440f52b0 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 0x7f12440f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:46.959 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 0x7f12440f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48656/0 (socket says 10.20.193.90:48656) 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 -- 10.20.193.90:0/3473386745 learned_addr learned my addr 10.20.193.90:0/3473386745 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1242ffd6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1244113180 0x7f1244173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 -- 10.20.193.90:0/3473386745 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f12440f52b0 msgr2=0x7f12440fa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1243fff6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f12440f52b0 0x7f12440fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f12440f52b0 0x7f12440fa580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 -- 10.20.193.90:0/3473386745 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1244113180 msgr2=0x7f1244173a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1244113180 0x7f1244173a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 -- 10.20.193.90:0/3473386745 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1234009590 con 0x7f124410cf70 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1242ffd6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1244113180 0x7f1244173a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1243fff6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f12440f52b0 0x7f12440fa580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:02:46.960 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f12437fe6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 0x7f12440f4c80 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f123000b710 tx=0x7f123000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1230004250 con 0x7f124410cf70 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1230009070 con 0x7f124410cf70 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f123000ccd0 con 0x7f124410cf70 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12440faf60 con 0x7f124410cf70 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12440fb3f0 con 0x7f124410cf70 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.955+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124410e240 con 0x7f124410cf70 2026-02-19T21:02:46.961 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.957+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 157027+0+0 (secure 0 0 0) 0x7f12300028c0 con 0x7f124410cf70 2026-02-19T21:02:46.962 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.957+0000 7f1240ff96c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f12180b5640 0x7f12180d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:46.962 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.957+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f12300e1e30 con 0x7f124410cf70 2026-02-19T21:02:46.962 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.957+0000 7f1242ffd6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f12180b5640 0x7f12180d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:46.962 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.957+0000 7f1242ffd6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f12180b5640 0x7f12180d5af0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1234005b40 tx=0x7f1234005de0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:46.962 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:46.958+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f12300a6470 con 0x7f124410cf70 2026-02-19T21:02:47.053 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:47.052+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f12440fb3f0 con 0x7f12180b5640 2026-02-19T21:02:47.318 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.318 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.318 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.319 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:47.320 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:47.320 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:47.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:47.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:47.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:47.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:47.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:47.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:48.644 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:48 trial105 ceph-mon[33883]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:48 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2946771645' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9447a1db-db31-41c0-8732-78156b284c70"} : dispatch 2026-02-19T21:02:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:48 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2946771645' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9447a1db-db31-41c0-8732-78156b284c70"}]': finished 2026-02-19T21:02:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:48 trial105 ceph-mon[33883]: osdmap e5: 1 total, 0 up, 1 in 2026-02-19T21:02:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:48 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:48 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2724557147' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:02:48.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:48 trial090 ceph-mon[31759]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:48 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2946771645' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9447a1db-db31-41c0-8732-78156b284c70"} : dispatch 2026-02-19T21:02:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:48 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2946771645' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9447a1db-db31-41c0-8732-78156b284c70"}]': finished 2026-02-19T21:02:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:48 trial090 ceph-mon[31759]: osdmap e5: 1 total, 0 up, 1 in 2026-02-19T21:02:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:48 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:48 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2724557147' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:02:48.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:48 trial175 ceph-mon[34116]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:48.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:48 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2946771645' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9447a1db-db31-41c0-8732-78156b284c70"} : dispatch 2026-02-19T21:02:48.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:48 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2946771645' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9447a1db-db31-41c0-8732-78156b284c70"}]': finished 2026-02-19T21:02:48.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:48 trial175 ceph-mon[34116]: osdmap e5: 1 total, 0 up, 1 in 2026-02-19T21:02:48.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:48 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:48.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:48 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2724557147' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:02:50.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:50 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-19T21:02:50.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:50 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:50.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:50 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-19T21:02:50.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:50 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:50 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-19T21:02:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:50 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:52.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:52.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:52.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:52.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:52.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:52.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:52.394 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:52.394 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:52.394 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:52.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.796+0000 7f1240ff96c0 1 -- 10.20.193.90:0/3473386745 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f12440fb3f0 con 0x7f12180b5640 2026-02-19T21:02:52.798 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 0 on host 'trial090' 2026-02-19T21:02:52.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f12180b5640 msgr2=0x7f12180d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:52.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f12180b5640 0x7f12180d5af0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1234005b40 tx=0x7f1234005de0 comp rx=0 tx=0).stop 2026-02-19T21:02:52.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 msgr2=0x7f12440f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:52.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 0x7f12440f4c80 secure :-1 s=READY pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f123000b710 tx=0x7f123000bbe0 comp rx=0 tx=0).stop 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 shutdown_connections 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f12180b5640 0x7f12180d5af0 unknown :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f12440f52b0 0x7f12440fa580 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1244113180 0x7f1244173a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 --2- 10.20.193.90:0/3473386745 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f124410cf70 0x7f12440f4c80 unknown :-1 s=CLOSED pgs=137 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 >> 10.20.193.90:0/3473386745 conn(0x7f12440ea870 msgr2=0x7f124410b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 shutdown_connections 2026-02-19T21:02:52.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:02:52.798+0000 7f1249e8c6c0 1 -- 10.20.193.90:0/3473386745 wait complete. 2026-02-19T21:02:52.843 DEBUG:teuthology.orchestra.run.trial090:osd.0> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.0.service 2026-02-19T21:02:52.845 INFO:tasks.cephadm:Deploying osd.1 on trial105 with /dev/vg_nvme/lv_4... 2026-02-19T21:02:52.846 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-19T21:02:52.969 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:02:53.376 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.376 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.376 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:53.376 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:53.376 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.376 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:53.377 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:53.377 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:53.377 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.377 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.377 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-19T21:02:53.377 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:53.427 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:02:53.444 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial105:vg_nvme/lv_4 --skip-validation 2026-02-19T21:02:53.568 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:02:53.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-19T21:02:53.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:53.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- 10.20.193.105:0/1946513559 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 msgr2=0x7fb778175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:53.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/1946513559 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb778175db0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=11545693805969473787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb77400aa40 tx=0x7fb77402fde0 comp rx=0 tx=0).stop 2026-02-19T21:02:53.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- 10.20.193.105:0/1946513559 shutdown_connections 2026-02-19T21:02:53.693 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/1946513559 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb778175db0 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=11545693805969473787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/1946513559 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb77810fbf0 0x7fb778114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/1946513559 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb77810f200 0x7fb77810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- 10.20.193.105:0/1946513559 >> 10.20.193.105:0/1946513559 conn(0x7fb7780ecac0 msgr2=0x7fb77810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- 10.20.193.105:0/1946513559 shutdown_connections 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- 10.20.193.105:0/1946513559 wait complete. 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 Processor -- start 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- start start 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb77810f200 0x7fb77811d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb77811d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:53.694 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb778122b50 0x7fb778122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb778123560 con 0x7fb77810f200 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781236d0 con 0x7fb778115410 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77ff316c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb778123890 con 0x7fb778122b50 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77d4a16c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb77811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77d4a16c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb77811d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.105:59620/0 (socket says 10.20.193.105:59620) 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77d4a16c0 1 -- 10.20.193.105:0/3470244600 learned_addr learned my addr 10.20.193.105:0/3470244600 (peer_addr_for_me v2:10.20.193.105:0/0) 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77e4a36c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb778122b50 0x7fb778122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.691+0000 7fb77dca26c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb77810f200 0x7fb77811d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77d4a16c0 1 -- 10.20.193.105:0/3470244600 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb778122b50 msgr2=0x7fb778122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:53.695 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77d4a16c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb778122b50 0x7fb778122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77d4a16c0 1 -- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb77810f200 msgr2=0x7fb77811d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77d4a16c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb77810f200 0x7fb77811d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77d4a16c0 1 -- 10.20.193.105:0/3470244600 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77400a660 con 0x7fb778115410 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77d4a16c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb77811d790 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb76c005dc0 tx=0x7fb76c00bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb76c004250 con 0x7fb778115410 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb76c009070 con 0x7fb778115410 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb778163d40 con 0x7fb778115410 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb76c00cd50 con 0x7fb778115410 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7781641d0 con 0x7fb778115410 2026-02-19T21:02:53.696 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.692+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7781104d0 con 0x7fb778115410 2026-02-19T21:02:53.698 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.693+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 13) ==== 157027+0+0 (secure 0 0 0) 0x7fb76c0028c0 con 0x7fb778115410 2026-02-19T21:02:53.698 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.694+0000 7fb766ffd6c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7540b55c0 0x7fb7540d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:02:53.698 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.694+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1265+0+0 (secure 0 0 0) 0x7fb76c0e1f80 con 0x7fb778115410 2026-02-19T21:02:53.698 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.694+0000 7fb77dca26c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7540b55c0 0x7fb7540d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:02:53.698 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.695+0000 7fb77dca26c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7540b55c0 0x7fb7540d5a70 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb768005980 tx=0x7fb768005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:02:53.698 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.695+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb76c0a6540 con 0x7fb778115410 2026-02-19T21:02:53.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-19T21:02:53.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:53.792 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:53.792+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb77811e400 con 0x7fb7540b55c0 2026-02-19T21:02:54.797 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:02:54 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0[45984]: 2026-02-19T21:02:54.468+0000 7f80bc0686c0 -1 osd.0 0 waiting for initial osdmap 2026-02-19T21:02:54.797 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:02:54 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0[45984]: 2026-02-19T21:02:54.470+0000 7f80b3f356c0 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:02:54.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:54.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:54.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: osdmap e6: 1 total, 0 up, 1 in 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:54.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/2052484506' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"} : dispatch 2026-02-19T21:02:54.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:02:54.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"}]': finished 2026-02-19T21:02:54.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: osdmap e7: 2 total, 0 up, 2 in 2026-02-19T21:02:54.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:54.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:54.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:54.898 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:54 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/1679876794' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:02:55.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:55.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: osdmap e6: 1 total, 0 up, 1 in 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:55.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/2052484506' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"}]': finished 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: osdmap e7: 2 total, 0 up, 2 in 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:55.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:55.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:55.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:54 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/1679876794' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:02:55.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:02:55.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-19T21:02:55.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: osdmap e6: 1 total, 0 up, 1 in 2026-02-19T21:02:55.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:02:55.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:55.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/2052484506' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2ceb6ac4-0471-49bc-b664-7b5053f54250"}]': finished 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: osdmap e7: 2 total, 0 up, 2 in 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:55.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:54 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/1679876794' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:02:56.611 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:02:56.611 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:02:56.611 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] boot 2026-02-19T21:02:56.611 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: osdmap e8: 2 total, 1 up, 2 in 2026-02-19T21:02:56.611 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:56.612 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:56.612 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:56.612 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:56 trial105 ceph-mon[33883]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:56.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] boot 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: osdmap e8: 2 total, 1 up, 2 in 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:56.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:56 trial175 ceph-mon[34116]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:56.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:02:56.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:02:56.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: osd.0 [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] boot 2026-02-19T21:02:56.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: osdmap e8: 2 total, 1 up, 2 in 2026-02-19T21:02:56.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-19T21:02:56.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:56.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: pgmap v7: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:56.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:56 trial090 ceph-mon[31759]: pgmap v8: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.693 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: osdmap e9: 2 total, 1 up, 2 in 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:57.694 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.695 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:57 trial105 ceph-mon[33883]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: osdmap e9: 2 total, 1 up, 2 in 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:57.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:57.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-19T21:02:57.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:57 trial175 ceph-mon[34116]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: osdmap e9: 2 total, 1 up, 2 in 2026-02-19T21:02:57.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-19T21:02:57.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:57.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:57 trial090 ceph-mon[31759]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:58.724 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:58 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:02:58.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:58 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:02:58.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:58 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:02:59.677 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:59.677 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.677 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.677 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:59.677 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.677 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:59.678 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:02:59 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:59.700 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.699+0000 7fb766ffd6c0 1 -- 10.20.193.105:0/3470244600 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb77811e400 con 0x7fb7540b55c0 2026-02-19T21:02:59.701 INFO:teuthology.orchestra.run.trial105.stdout:Created osd(s) 1 on host 'trial105' 2026-02-19T21:02:59.703 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7540b55c0 msgr2=0x7fb7540d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:59.703 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7540b55c0 0x7fb7540d5a70 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb768005980 tx=0x7fb768005910 comp rx=0 tx=0).stop 2026-02-19T21:02:59.703 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 msgr2=0x7fb77811d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb77811d790 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb76c005dc0 tx=0x7fb76c00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 shutdown_connections 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7540b55c0 0x7fb7540d5a70 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb778122b50 0x7fb778122ff0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb778115410 0x7fb77811d790 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 --2- 10.20.193.105:0/3470244600 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb77810f200 0x7fb77811d250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 >> 10.20.193.105:0/3470244600 conn(0x7fb7780ecac0 msgr2=0x7fb77810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 shutdown_connections 2026-02-19T21:02:59.704 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:02:59.702+0000 7fb77ff316c0 1 -- 10.20.193.105:0/3470244600 wait complete. 2026-02-19T21:02:59.742 DEBUG:teuthology.orchestra.run.trial105:osd.1> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.1.service 2026-02-19T21:02:59.744 INFO:tasks.cephadm:Deploying osd.2 on trial175 with /dev/vg_nvme/lv_4... 2026-02-19T21:02:59.744 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-19T21:02:59.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:59.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:59.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:02:59 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:59.866 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:02:59.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:02:59.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:59.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:02:59.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:02:59 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:02:59.951 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:02:59 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1[39752]: 2026-02-19T21:02:59.816+0000 7efcaba7b780 -1 osd.1 0 log_to_monitors true 2026-02-19T21:03:00.321 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:03:00.337 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial175:vg_nvme/lv_4 --skip-validation 2026-02-19T21:03:00.498 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:03:00.621 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1091720612 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 msgr2=0x7f1fe8114150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1091720612 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe8114150 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=17767248110205834533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fdc009970 tx=0x7f1fdc02ed20 comp rx=0 tx=0).stop 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1091720612 shutdown_connections 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1091720612 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 0x7f1fe817c390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1091720612 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1fe8114690 0x7f1fe815ba70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1091720612 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe8114150 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=17767248110205834533 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.618+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1091720612 >> 10.20.193.175:0/1091720612 conn(0x7f1fe80589f0 msgr2=0x7f1fe8058df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1091720612 shutdown_connections 2026-02-19T21:03:00.622 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1091720612 wait complete. 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 Processor -- start 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- start start 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe81041e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1fe8114690 0x7f1fe8104720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 0x7f1fe8109ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe810a130 con 0x7f1fe815bfb0 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe810a2a0 con 0x7f1fe8114690 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe810a460 con 0x7f1fe8113d80 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe81041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe81041e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.175:43810/0 (socket says 10.20.193.175:43810) 2026-02-19T21:03:00.623 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 -- 10.20.193.175:0/1332992640 learned_addr learned my addr 10.20.193.175:0/1332992640 (peer_addr_for_me v2:10.20.193.175:0/0) 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 -- 10.20.193.175:0/1332992640 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1fe8114690 msgr2=0x7f1fe8104720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1fe8114690 0x7f1fe8104720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe77fe6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 0x7f1fe8109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 -- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 msgr2=0x7f1fe8109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 0x7f1fe8109ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 -- 10.20.193.175:0/1332992640 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fdc009590 con 0x7f1fe8113d80 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe77fe6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 0x7f1fe8109ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fe6ffd6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe81041e0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fdc0092b0 tx=0x7f1fdc02fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1fdc002ba0 con 0x7f1fe8113d80 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1fdc002d00 con 0x7f1fe8113d80 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe810a6e0 con 0x7f1fe8113d80 2026-02-19T21:03:00.624 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1fdc0372f0 con 0x7f1fe8113d80 2026-02-19T21:03:00.625 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.619+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe8155950 con 0x7f1fe8113d80 2026-02-19T21:03:00.625 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.620+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe805afe0 con 0x7f1fe8113d80 2026-02-19T21:03:00.626 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.621+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 13) ==== 157027+0+0 (secure 0 0 0) 0x7f1fdc007910 con 0x7f1fe8113d80 2026-02-19T21:03:00.626 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.622+0000 7f1fec84e6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1fbc0b5640 0x7f1fbc0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:00.626 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.622+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1875+0+0 (secure 0 0 0) 0x7f1fdc106320 con 0x7f1fe8113d80 2026-02-19T21:03:00.626 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.622+0000 7f1fe67fc6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1fbc0b5640 0x7f1fbc0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:00.626 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.622+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1fdc0ca750 con 0x7f1fe8113d80 2026-02-19T21:03:00.626 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.623+0000 7f1fe67fc6c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1fbc0b5640 0x7f1fbc0d5af0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fe810ab70 tx=0x7f1fd0006d50 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:00.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:00.717+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f1fe8105330 con 0x7f1fbc0b5640 2026-02-19T21:03:00.873 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:00.873 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:00.873 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-19T21:03:00.874 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: from='osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-19T21:03:00.874 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:00.874 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:00.874 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:03:00.874 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: from='osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:03:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-19T21:03:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: from='osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-19T21:03:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:01.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:01.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:03:01.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:01.645 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:01 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1[39752]: 2026-02-19T21:03:01.381+0000 7efca799c6c0 -1 osd.1 0 waiting for initial osdmap 2026-02-19T21:03:01.645 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:01 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1[39752]: 2026-02-19T21:03:01.384+0000 7efca38716c0 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:01.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-19T21:03:01.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: osdmap e10: 2 total, 1 up, 2 in 2026-02-19T21:03:01.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:01.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:01.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:01.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/556832615' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"}]': finished 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: osdmap e11: 3 total, 1 up, 3 in 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:01.769 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:01.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:01.770 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:01 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1703485429' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:02.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-19T21:03:02.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: osdmap e10: 2 total, 1 up, 2 in 2026-02-19T21:03:02.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:02.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:02.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:02.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:02.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:02.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"} : dispatch 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/556832615' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"} : dispatch 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"}]': finished 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: osdmap e11: 3 total, 1 up, 3 in 2026-02-19T21:03:02.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:02.149 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:02.149 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:02.149 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:01 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1703485429' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:02.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-19T21:03:02.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: osdmap e10: 2 total, 1 up, 2 in 2026-02-19T21:03:02.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:02.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:02.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:02.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='client.24304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:02.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:02.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/556832615' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"} : dispatch 2026-02-19T21:03:02.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:02.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ded8050-146f-41a3-a2e7-974118414769"}]': finished 2026-02-19T21:03:02.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: osdmap e11: 3 total, 1 up, 3 in 2026-02-19T21:03:02.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:02.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:02.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:02.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:01 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1703485429' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:03.540 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:03.541 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:03.541 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] boot 2026-02-19T21:03:03.541 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: osdmap e12: 3 total, 2 up, 3 in 2026-02-19T21:03:03.541 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:03.541 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:03.541 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:03 trial175 ceph-mon[34116]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:03.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:03.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:03.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] boot 2026-02-19T21:03:03.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: osdmap e12: 3 total, 2 up, 3 in 2026-02-19T21:03:03.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:03.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:03.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:03 trial105 ceph-mon[33883]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:03.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:03.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:03.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: osd.1 [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] boot 2026-02-19T21:03:03.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: osdmap e12: 3 total, 2 up, 3 in 2026-02-19T21:03:03.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-19T21:03:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:03 trial090 ceph-mon[31759]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.637 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: osdmap e13: 3 total, 2 up, 3 in 2026-02-19T21:03:04.637 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:04.637 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.637 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.638 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:04 trial175 ceph-mon[34116]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: osdmap e13: 3 total, 2 up, 3 in 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:04 trial105 ceph-mon[33883]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: osdmap e13: 3 total, 2 up, 3 in 2026-02-19T21:03:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:04 trial090 ceph-mon[31759]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:05.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:05 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:05.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:05 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:05.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:05 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:06.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:06 trial105 ceph-mon[33883]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:06.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:06 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:06.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:06 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:06.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:06 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:06 trial090 ceph-mon[31759]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:06 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:06 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:06 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:06.753 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:06 trial175 ceph-mon[34116]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:06.753 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:06 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:06.754 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:06 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:06.754 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:06 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.102 INFO:teuthology.orchestra.run.trial175.stdout:Created osd(s) 2 on host 'trial175' 2026-02-19T21:03:07.103 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.100+0000 7f1fec84e6c0 1 -- 10.20.193.175:0/1332992640 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1fe8105330 con 0x7f1fbc0b5640 2026-02-19T21:03:07.104 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.102+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1fbc0b5640 msgr2=0x7f1fbc0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:07.104 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.102+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1fbc0b5640 0x7f1fbc0d5af0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fe810ab70 tx=0x7f1fd0006d50 comp rx=0 tx=0).stop 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.102+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 msgr2=0x7f1fe81041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.102+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe81041e0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fdc0092b0 tx=0x7f1fdc02fd40 comp rx=0 tx=0).stop 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 shutdown_connections 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1fbc0b5640 0x7f1fbc0d5af0 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1fe815bfb0 0x7f1fe8109ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1fe8114690 0x7f1fe8104720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 --2- 10.20.193.175:0/1332992640 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1fe8113d80 0x7f1fe81041e0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 >> 10.20.193.175:0/1332992640 conn(0x7f1fe80589f0 msgr2=0x7f1fe80feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 shutdown_connections 2026-02-19T21:03:07.105 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:07.103+0000 7f1fed8546c0 1 -- 10.20.193.175:0/1332992640 wait complete. 2026-02-19T21:03:07.143 DEBUG:teuthology.orchestra.run.trial175:osd.2> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.2.service 2026-02-19T21:03:07.144 INFO:tasks.cephadm:Deploying osd.3 on trial090 with /dev/vg_nvme/lv_3... 2026-02-19T21:03:07.144 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-19T21:03:07.268 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:03:07.688 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.688 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.688 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-19T21:03:07.689 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:07.734 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:03:07.750 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_3 --skip-validation 2026-02-19T21:03:07.876 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:03:07.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:07.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:07.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-19T21:03:07.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:08.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 -- 10.20.193.90:0/1787454884 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 msgr2=0x7f2c64175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:08.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 --2- 10.20.193.90:0/1787454884 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c64175db0 secure :-1 s=READY pgs=145 gs=1 cs=0 l=1 c_cookie=329714633073665780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c5400aa70 tx=0x7f2c5402fde0 comp rx=0 tx=0).stop 2026-02-19T21:03:08.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 -- 10.20.193.90:0/1787454884 shutdown_connections 2026-02-19T21:03:08.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 --2- 10.20.193.90:0/1787454884 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c64175db0 unknown :-1 s=CLOSED pgs=145 gs=1 cs=0 l=1 c_cookie=329714633073665780 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:08.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 --2- 10.20.193.90:0/1787454884 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c6410fbf0 0x7f2c64114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 --2- 10.20.193.90:0/1787454884 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c6410f200 0x7f2c6410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 -- 10.20.193.90:0/1787454884 >> 10.20.193.90:0/1787454884 conn(0x7f2c640eca60 msgr2=0x7f2c6410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 -- 10.20.193.90:0/1787454884 shutdown_connections 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.002+0000 7f2c698746c0 1 -- 10.20.193.90:0/1787454884 wait complete. 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 Processor -- start 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 -- start start 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c6410f200 0x7f2c6411d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c6411d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c64122b50 0x7f2c64122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:08.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64123560 con 0x7f2c64115410 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c641236d0 con 0x7f2c6410f200 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c64123890 con 0x7f2c64122b50 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c6411d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c6411d790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:60326/0 (socket says 10.20.193.90:60326) 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 -- 10.20.193.90:0/2038536838 learned_addr learned my addr 10.20.193.90:0/2038536838 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c62ffd6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c6410f200 0x7f2c6411d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c637fe6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c64122b50 0x7f2c64122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 -- 10.20.193.90:0/2038536838 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c64122b50 msgr2=0x7f2c64122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c64122b50 0x7f2c64122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 -- 10.20.193.90:0/2038536838 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c6410f200 msgr2=0x7f2c6411d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:08.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c6410f200 0x7f2c6411d250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 -- 10.20.193.90:0/2038536838 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5400a660 con 0x7f2c64115410 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c627fc6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c6411d790 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4c005dc0 tx=0x7f2c4c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c4c004250 con 0x7f2c64115410 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2c4c009070 con 0x7f2c64115410 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c4c00cd50 con 0x7f2c64115410 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c64163d40 con 0x7f2c64115410 2026-02-19T21:03:08.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.003+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c641641d0 con 0x7f2c64115410 2026-02-19T21:03:08.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.004+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c641104d0 con 0x7f2c64115410 2026-02-19T21:03:08.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.005+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 13) ==== 157027+0+0 (secure 0 0 0) 0x7f2c4c0028c0 con 0x7f2c64115410 2026-02-19T21:03:08.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.005+0000 7f2c6886e6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c380b5640 0x7f2c380d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:08.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.006+0000 7f2c62ffd6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c380b5640 0x7f2c380d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:08.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.006+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2415+0+0 (secure 0 0 0) 0x7f2c4c0e2310 con 0x7f2c64115410 2026-02-19T21:03:08.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.006+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c4c0a64a0 con 0x7f2c64115410 2026-02-19T21:03:08.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.006+0000 7f2c62ffd6c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c380b5640 0x7f2c380d5af0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c58005980 tx=0x7f2c580094b0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:08.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:08.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-19T21:03:08.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-19T21:03:08.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:08.103 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:08.102+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f2c6411e430 con 0x7f2c380b5640 2026-02-19T21:03:09.104 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:08 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2[40458]: 2026-02-19T21:03:08.781+0000 7f6e2fdf36c0 -1 osd.2 0 waiting for initial osdmap 2026-02-19T21:03:09.104 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:08 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2[40458]: 2026-02-19T21:03:08.784+0000 7f6e27cc06c0 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: osdmap e14: 3 total, 2 up, 3 in 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:09.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1719040976' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "556df040-373e-4795-af5e-297ede87881b"} : dispatch 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1719040976' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "556df040-373e-4795-af5e-297ede87881b"}]': finished 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: osdmap e15: 4 total, 2 up, 4 in 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.159 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:09.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.160 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:09 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1960116554' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: osdmap e14: 3 total, 2 up, 3 in 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1719040976' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "556df040-373e-4795-af5e-297ede87881b"} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1719040976' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "556df040-373e-4795-af5e-297ede87881b"}]': finished 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: osdmap e15: 4 total, 2 up, 4 in 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:09 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1960116554' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:09.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:09.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-19T21:03:09.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: osdmap e14: 3 total, 2 up, 3 in 2026-02-19T21:03:09.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='client.14463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:09.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1719040976' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "556df040-373e-4795-af5e-297ede87881b"} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1719040976' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "556df040-373e-4795-af5e-297ede87881b"}]': finished 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: osdmap e15: 4 total, 2 up, 4 in 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:09.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:09.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:09 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1960116554' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:10 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:10 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:10 trial105 ceph-mon[33883]: osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] boot 2026-02-19T21:03:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:10 trial105 ceph-mon[33883]: osdmap e16: 4 total, 3 up, 4 in 2026-02-19T21:03:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:10.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:10.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:10 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:10.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:10 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:10.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:10 trial090 ceph-mon[31759]: osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] boot 2026-02-19T21:03:10.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:10 trial090 ceph-mon[31759]: osdmap e16: 4 total, 3 up, 4 in 2026-02-19T21:03:10.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:10.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:10.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:10 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:10.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:10 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:10.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:10 trial175 ceph-mon[34116]: osd.2 [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] boot 2026-02-19T21:03:10.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:10 trial175 ceph-mon[34116]: osdmap e16: 4 total, 3 up, 4 in 2026-02-19T21:03:10.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-19T21:03:10.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:11.242 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:11.242 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:11.242 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:11.242 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:11.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:11.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:11.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:11.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:11.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:11.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: pgmap v32: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:11.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:11.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: pgmap v33: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: pgmap v34: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: osdmap e17: 4 total, 3 up, 4 in 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:12.363 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:03:12.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: pgmap v33: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:12.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: pgmap v34: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:12.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: osdmap e17: 4 total, 3 up, 4 in 2026-02-19T21:03:12.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:12.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-19T21:03:12.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:12.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:03:12.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: pgmap v33: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:12.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: pgmap v34: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:12.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: osdmap e17: 4 total, 3 up, 4 in 2026-02-19T21:03:12.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:12.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-19T21:03:12.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:12.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:03:13.300 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 ceph-mon[31759]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:13.300 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 ceph-mon[31759]: osdmap e18: 4 total, 3 up, 4 in 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52139]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52139]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.301 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52139]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52032]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52032]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52032]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52036]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52036]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.302 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52036]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.378 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 ceph-mon[33883]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:13.378 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:13.378 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-19T21:03:13.379 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 ceph-mon[33883]: osdmap e18: 4 total, 3 up, 4 in 2026-02-19T21:03:13.379 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:13.379 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:03:13.379 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42806]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-19T21:03:13.379 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42806]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.379 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.379 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42806]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.379 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42810]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-19T21:03:13.380 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42810]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.380 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.380 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42810]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 ceph-mon[34116]: pgmap v36: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:13.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 ceph-mon[34116]: osdmap e18: 4 total, 3 up, 4 in 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43700]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43700]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43700]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43704]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-19T21:03:13.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43704]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43704]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43692]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43692]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43692]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43696]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.520 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:03:13 trial175 sudo[43696]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.551 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52148]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-19T21:03:13.551 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52148]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.551 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.551 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:13 trial090 sudo[52148]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42814]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-19T21:03:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42814]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42814]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42818]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-19T21:03:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42818]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-19T21:03:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-19T21:03:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:13 trial105 sudo[42818]: pam_unix(sudo:session): session closed for user root 2026-02-19T21:03:14.220 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-19T21:03:14.220 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: osdmap e19: 4 total, 3 up, 4 in 2026-02-19T21:03:14.220 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:14.220 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.220 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.221 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.222 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.223 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:14.223 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:14.223 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.223 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:14.223 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:14.223 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:14.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.275+0000 7f2c6886e6c0 1 -- 10.20.193.90:0/2038536838 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f2c58009020 con 0x7f2c380b5640 2026-02-19T21:03:14.277 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 3 on host 'trial090' 2026-02-19T21:03:14.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c380b5640 msgr2=0x7f2c380d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c380b5640 0x7f2c380d5af0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c58005980 tx=0x7f2c580094b0 comp rx=0 tx=0).stop 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 msgr2=0x7f2c6411d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c6411d790 secure :-1 s=READY pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4c005dc0 tx=0x7f2c4c00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 shutdown_connections 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c380b5640 0x7f2c380d5af0 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c64122b50 0x7f2c64122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:14.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c64115410 0x7f2c6411d790 unknown :-1 s=CLOSED pgs=146 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:14.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 --2- 10.20.193.90:0/2038536838 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c6410f200 0x7f2c6411d250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:14.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 >> 10.20.193.90:0/2038536838 conn(0x7f2c640eca60 msgr2=0x7f2c6410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:14.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 shutdown_connections 2026-02-19T21:03:14.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:14.278+0000 7f2c698746c0 1 -- 10.20.193.90:0/2038536838 wait complete. 2026-02-19T21:03:14.324 DEBUG:teuthology.orchestra.run.trial090:osd.3> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.3.service 2026-02-19T21:03:14.326 INFO:tasks.cephadm:Deploying osd.4 on trial105 with /dev/vg_nvme/lv_3... 2026-02-19T21:03:14.326 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-19T21:03:14.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: osdmap e19: 4 total, 3 up, 4 in 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:14.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:14.456 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: osdmap e19: 4 total, 3 up, 4 in 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:14.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:14.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:14.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:14.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:14.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:14.905 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:03:14.920 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial105:vg_nvme/lv_3 --skip-validation 2026-02-19T21:03:15.042 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:03:15.165 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 -- 10.20.193.105:0/3302530682 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10fbf0 msgr2=0x7f05bc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/3302530682 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10fbf0 0x7f05bc114c30 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=5219938033771165631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05b0009970 tx=0x7f05b002ed20 comp rx=0 tx=0).stop 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 -- 10.20.193.105:0/3302530682 shutdown_connections 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/3302530682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05bc115410 0x7f05bc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/3302530682 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10fbf0 0x7f05bc114c30 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=5219938033771165631 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/3302530682 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f05bc10f200 0x7f05bc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 -- 10.20.193.105:0/3302530682 >> 10.20.193.105:0/3302530682 conn(0x7f05bc0ecac0 msgr2=0x7f05bc10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 -- 10.20.193.105:0/3302530682 shutdown_connections 2026-02-19T21:03:15.166 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.162+0000 7f05c32f46c0 1 -- 10.20.193.105:0/3302530682 wait complete. 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 Processor -- start 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 -- start start 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 0x7f05bc0f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f05bc115410 0x7f05bc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05bc0f5270 0x7f05bc0fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0f5960 con 0x7f05bc0f5270 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0faa80 con 0x7f05bc10f200 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05bc0fac40 con 0x7f05bc115410 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 0x7f05bc0f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 0x7f05bc0f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.105:54776/0 (socket says 10.20.193.105:54776) 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 -- 10.20.193.105:0/2070880666 learned_addr learned my addr 10.20.193.105:0/2070880666 (peer_addr_for_me v2:10.20.193.105:0/0) 2026-02-19T21:03:15.167 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c08686c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f05bc115410 0x7f05bc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c186a6c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05bc0f5270 0x7f05bc0fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 -- 10.20.193.105:0/2070880666 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f05bc115410 msgr2=0x7f05bc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f05bc115410 0x7f05bc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 -- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05bc0f5270 msgr2=0x7f05bc0fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05bc0f5270 0x7f05bc0fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 -- 10.20.193.105:0/2070880666 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b0009590 con 0x7f05bc10f200 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c10696c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 0x7f05bc0f4c40 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac00b6f0 tx=0x7f05ac00bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac0044a0 con 0x7f05bc10f200 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f05ac009030 con 0x7f05bc10f200 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05bc0faf20 con 0x7f05bc10f200 2026-02-19T21:03:15.168 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac00cbe0 con 0x7f05bc10f200 2026-02-19T21:03:15.169 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.163+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05bc0fb6b0 con 0x7f05bc10f200 2026-02-19T21:03:15.169 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.164+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05bc1104d0 con 0x7f05bc10f200 2026-02-19T21:03:15.169 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.165+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 13) ==== 157027+0+0 (secure 0 0 0) 0x7f05ac005080 con 0x7f05bc10f200 2026-02-19T21:03:15.170 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.166+0000 7f05aa7fc6c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f05980b55c0 0x7f05980d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:15.170 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.166+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3344+0+0 (secure 0 0 0) 0x7f05ac0e26f0 con 0x7f05bc10f200 2026-02-19T21:03:15.170 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.166+0000 7f05c08686c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f05980b55c0 0x7f05980d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:15.170 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.166+0000 7f05c08686c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f05980b55c0 0x7f05980d5a70 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05b00092e0 tx=0x7f05b0005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:15.170 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.167+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f05ac0a6550 con 0x7f05bc10f200 2026-02-19T21:03:15.262 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.262+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f05bc0f5d90 con 0x7f05980b55c0 2026-02-19T21:03:15.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: pgmap v39: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:15.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: pgmap v40: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:15.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: osdmap e20: 4 total, 3 up, 4 in 2026-02-19T21:03:15.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:15.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:15.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:15.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-19T21:03:15.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:15.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:15.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:15 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:15.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: pgmap v39: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:15.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: pgmap v40: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:15.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: osdmap e20: 4 total, 3 up, 4 in 2026-02-19T21:03:15.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:15.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:15.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:15.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-19T21:03:15.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:15.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:15.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:15 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:15.417 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:15.416+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f05ac0a6170 con 0x7f05bc10f200 2026-02-19T21:03:15.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: pgmap v39: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: pgmap v40: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: osdmap e20: 4 total, 3 up, 4 in 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:15.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:15 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:16.267 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:03:15 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3[52144]: 2026-02-19T21:03:15.925+0000 7fe5a117b6c0 -1 osd.3 0 waiting for initial osdmap 2026-02-19T21:03:16.267 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:03:15 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3[52144]: 2026-02-19T21:03:15.928+0000 7fe5990486c0 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-19T21:03:16.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: osdmap e21: 4 total, 3 up, 4 in 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: mgrmap e14: x(active, since 34s), standbys: z, y 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/1491524938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"}]': finished 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: osdmap e22: 5 total, 3 up, 5 in 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:16 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/64694334' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:16.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: osdmap e21: 4 total, 3 up, 4 in 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:16.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: mgrmap e14: x(active, since 34s), standbys: z, y 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/1491524938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"} : dispatch 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"} : dispatch 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"}]': finished 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: osdmap e22: 5 total, 3 up, 5 in 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:16.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:16 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/64694334' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: osdmap e21: 4 total, 3 up, 4 in 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:16.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: mgrmap e14: x(active, since 34s), standbys: z, y 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/1491524938' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0776450-d439-4c5d-a67d-0ae50bb72319"}]': finished 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: osdmap e22: 5 total, 3 up, 5 in 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:16.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:16 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/64694334' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:17.547 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:17 trial105 ceph-mon[33883]: pgmap v44: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:17.547 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:17 trial105 ceph-mon[33883]: osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] boot 2026-02-19T21:03:17.547 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:17 trial105 ceph-mon[33883]: osdmap e23: 5 total, 4 up, 5 in 2026-02-19T21:03:17.548 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:17.548 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:17.557 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:17 trial090 ceph-mon[31759]: pgmap v44: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:17.557 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:17 trial090 ceph-mon[31759]: osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] boot 2026-02-19T21:03:17.557 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:17 trial090 ceph-mon[31759]: osdmap e23: 5 total, 4 up, 5 in 2026-02-19T21:03:17.558 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:17.558 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:17.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:17 trial175 ceph-mon[34116]: pgmap v44: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-19T21:03:17.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:17 trial175 ceph-mon[34116]: osd.3 [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] boot 2026-02-19T21:03:17.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:17 trial175 ceph-mon[34116]: osdmap e23: 5 total, 4 up, 5 in 2026-02-19T21:03:17.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-19T21:03:17.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:18.362 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:18.362 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:18.362 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: osdmap e24: 5 total, 4 up, 5 in 2026-02-19T21:03:18.362 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:18.362 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:18.363 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:18.364 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: osdmap e24: 5 total, 4 up, 5 in 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:18.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:18.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:18.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: osdmap e24: 5 total, 4 up, 5 in 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:19.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: pgmap v49: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-19T21:03:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: osdmap e25: 5 total, 4 up, 5 in 2026-02-19T21:03:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:19.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: pgmap v49: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-19T21:03:19.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:19.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: osdmap e25: 5 total, 4 up, 5 in 2026-02-19T21:03:19.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: pgmap v47: 1 pgs: 1 creating+peering; 0 B data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: pgmap v49: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-19T21:03:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: osdmap e25: 5 total, 4 up, 5 in 2026-02-19T21:03:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:20.465 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:20 trial105 ceph-mon[33883]: pgmap v51: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:20.465 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:20 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:20.465 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:20 trial105 ceph-mon[33883]: osdmap e26: 5 total, 4 up, 5 in 2026-02-19T21:03:20.465 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:20.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:20 trial090 ceph-mon[31759]: pgmap v51: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:20.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:20 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:20 trial090 ceph-mon[31759]: osdmap e26: 5 total, 4 up, 5 in 2026-02-19T21:03:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:20.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:20 trial175 ceph-mon[34116]: pgmap v51: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:20 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:20 trial175 ceph-mon[34116]: osdmap e26: 5 total, 4 up, 5 in 2026-02-19T21:03:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:21.350 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:21.350 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.350 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: osdmap e27: 5 total, 4 up, 5 in 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:21.351 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:21.381 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.379+0000 7f05aa7fc6c0 1 -- 10.20.193.105:0/2070880666 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f05bc0f5d90 con 0x7f05980b55c0 2026-02-19T21:03:21.381 INFO:teuthology.orchestra.run.trial105.stdout:Created osd(s) 4 on host 'trial105' 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f05980b55c0 msgr2=0x7f05980d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f05980b55c0 0x7f05980d5a70 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05b00092e0 tx=0x7f05b0005c00 comp rx=0 tx=0).stop 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 msgr2=0x7f05bc0f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 0x7f05bc0f4c40 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac00b6f0 tx=0x7f05ac00bbc0 comp rx=0 tx=0).stop 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 shutdown_connections 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f05980b55c0 0x7f05980d5a70 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f05bc0f5270 0x7f05bc0fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f05bc115410 0x7f05bc175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 --2- 10.20.193.105:0/2070880666 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f05bc10f200 0x7f05bc0f4c40 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 >> 10.20.193.105:0/2070880666 conn(0x7f05bc0ecac0 msgr2=0x7f05bc10d880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 shutdown_connections 2026-02-19T21:03:21.383 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:21.382+0000 7f05c32f46c0 1 -- 10.20.193.105:0/2070880666 wait complete. 2026-02-19T21:03:21.422 DEBUG:teuthology.orchestra.run.trial105:osd.4> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.4.service 2026-02-19T21:03:21.423 INFO:tasks.cephadm:Deploying osd.5 on trial175 with /dev/vg_nvme/lv_3... 2026-02-19T21:03:21.423 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-19T21:03:21.550 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:03:21.572 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: osdmap e27: 5 total, 4 up, 5 in 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.573 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:21.574 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:21.574 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:21.640 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:03:21 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4[45852]: 2026-02-19T21:03:21.502+0000 7feaf8831780 -1 osd.4 0 log_to_monitors true 2026-02-19T21:03:21.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:21.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: osdmap e27: 5 total, 4 up, 5 in 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:21.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:21.999 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:03:22.015 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial175:vg_nvme/lv_3 --skip-validation 2026-02-19T21:03:22.138 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:03:22.253 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/3031991303 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e410e6f0 msgr2=0x7fd6e4152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:22.253 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/3031991303 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e410e6f0 0x7fd6e4152d70 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=17861530988692420776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d8009970 tx=0x7fd6d802ed20 comp rx=0 tx=0).stop 2026-02-19T21:03:22.253 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/3031991303 shutdown_connections 2026-02-19T21:03:22.253 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/3031991303 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6e41532b0 0x7fd6e41736d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:22.253 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/3031991303 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e410e6f0 0x7fd6e4152d70 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=17861530988692420776 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/3031991303 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6e410dd00 0x7fd6e410e0d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/3031991303 >> 10.20.193.175:0/3031991303 conn(0x7fd6e40e9710 msgr2=0x7fd6e4109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/3031991303 shutdown_connections 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/3031991303 wait complete. 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 Processor -- start 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.250+0000 7fd6ec0386c0 1 -- start start 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6e410dd00 0x7fd6e4161dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6e410e6f0 0x7fd6e4162310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 0x7fd6e41676d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4167d20 con 0x7fd6e410e6f0 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4167e90 con 0x7fd6e410dd00 2026-02-19T21:03:22.254 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e4168050 con 0x7fd6e41532b0 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 0x7fd6e41676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 0x7fd6e41676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.175:36358/0 (socket says 10.20.193.175:36358) 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 -- 10.20.193.175:0/2328291192 learned_addr learned my addr 10.20.193.175:0/2328291192 (peer_addr_for_me v2:10.20.193.175:0/0) 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6e95ac6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6e410e6f0 0x7fd6e4162310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6e9dad6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6e410dd00 0x7fd6e4161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 -- 10.20.193.175:0/2328291192 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6e410dd00 msgr2=0x7fd6e4161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6e410dd00 0x7fd6e4161dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 -- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6e410e6f0 msgr2=0x7fd6e4162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6e410e6f0 0x7fd6e4162310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 -- 10.20.193.175:0/2328291192 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d8009590 con 0x7fd6e41532b0 2026-02-19T21:03:22.255 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ea5ae6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 0x7fd6e41676d0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e000c6c0 tx=0x7fd6e000cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:22.256 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e0003c40 con 0x7fd6e41532b0 2026-02-19T21:03:22.256 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd6e000a030 con 0x7fd6e41532b0 2026-02-19T21:03:22.256 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e4168330 con 0x7fd6e41532b0 2026-02-19T21:03:22.256 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6e000db70 con 0x7fd6e41532b0 2026-02-19T21:03:22.256 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e414eee0 con 0x7fd6e41532b0 2026-02-19T21:03:22.256 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.251+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e405fab0 con 0x7fd6e41532b0 2026-02-19T21:03:22.257 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.253+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fd6e000dd20 con 0x7fd6e41532b0 2026-02-19T21:03:22.257 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.254+0000 7fd6d2ffd6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd6c00b56d0 0x7fd6c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:22.257 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.254+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3776+0+0 (secure 0 0 0) 0x7fd6e00e37e0 con 0x7fd6e41532b0 2026-02-19T21:03:22.257 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.254+0000 7fd6e9dad6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd6c00b56d0 0x7fd6c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:22.257 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.254+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6e00a7360 con 0x7fd6e41532b0 2026-02-19T21:03:22.258 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.255+0000 7fd6e9dad6c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd6c00b56d0 0x7fd6c00d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4005dc0 tx=0x7fd6d4005d10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:22.354 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:22.353+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd6e4162f20 con 0x7fd6c00b56d0 2026-02-19T21:03:22.511 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: pgmap v54: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: pgmap v56: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: from='osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-19T21:03:22.512 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:22.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: pgmap v54: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:22.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: pgmap v56: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: from='osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-19T21:03:22.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: pgmap v54: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: pgmap v56: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:22.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:22.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:22.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: from='osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-19T21:03:22.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-19T21:03:22.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:23.280 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:03:23 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4[45852]: 2026-02-19T21:03:23.000+0000 7feaf47526c0 -1 osd.4 0 waiting for initial osdmap 2026-02-19T21:03:23.280 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:03:23 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4[45852]: 2026-02-19T21:03:23.004+0000 7feaec61f6c0 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: pgmap v57: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: osdmap e28: 5 total, 4 up, 5 in 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/2353891285' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"}]': finished 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: osdmap e29: 6 total, 4 up, 6 in 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:23.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: pgmap v57: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-19T21:03:23.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: osdmap e28: 5 total, 4 up, 5 in 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/2353891285' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"}]': finished 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: osdmap e29: 6 total, 4 up, 6 in 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:23.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: pgmap v57: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:23.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: osdmap e28: 5 total, 4 up, 5 in 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:23.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"} : dispatch 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/2353891285' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"} : dispatch 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3450f832-0b90-45d7-a92d-b74809259564"}]': finished 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: osdmap e29: 6 total, 4 up, 6 in 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:23.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:24.614 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:24.615 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-19T21:03:24.615 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1979105099' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:24.615 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] boot 2026-02-19T21:03:24.615 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: osdmap e30: 6 total, 5 up, 6 in 2026-02-19T21:03:24.615 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:24.615 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-19T21:03:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1979105099' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] boot 2026-02-19T21:03:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: osdmap e30: 6 total, 5 up, 6 in 2026-02-19T21:03:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:24.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:24.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:24.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-19T21:03:24.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1979105099' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:24.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: osd.4 [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] boot 2026-02-19T21:03:24.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: osdmap e30: 6 total, 5 up, 6 in 2026-02-19T21:03:24.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-19T21:03:24.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:25.499 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:25.500 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:25.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:25.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:25.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:25.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 169 KiB/s, 0 objects/s recovering 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: osdmap e31: 6 total, 5 up, 6 in 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-19T21:03:26.342 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:26.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-19T21:03:26.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 169 KiB/s, 0 objects/s recovering 2026-02-19T21:03:26.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:26.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: osdmap e31: 6 total, 5 up, 6 in 2026-02-19T21:03:26.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:26.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-19T21:03:26.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:26.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: pgmap v62: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-19T21:03:26.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: pgmap v63: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 169 KiB/s, 0 objects/s recovering 2026-02-19T21:03:26.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:26.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: osdmap e31: 6 total, 5 up, 6 in 2026-02-19T21:03:26.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:26.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-19T21:03:26.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:27.592 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:27 trial175 ceph-mon[34116]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:27.592 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:27 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:27.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:27 trial105 ceph-mon[33883]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:27.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:27 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:27.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:27 trial090 ceph-mon[31759]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:27.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:27 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:28.470 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:28.471 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:28.471 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:28.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:28.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:28.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:28.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:28.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:28.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:28.703 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.703+0000 7fd6d2ffd6c0 1 -- 10.20.193.175:0/2328291192 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd6e4162f20 con 0x7fd6c00b56d0 2026-02-19T21:03:28.704 INFO:teuthology.orchestra.run.trial175.stdout:Created osd(s) 5 on host 'trial175' 2026-02-19T21:03:28.706 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.705+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd6c00b56d0 msgr2=0x7fd6c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:28.706 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.705+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd6c00b56d0 0x7fd6c00d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d4005dc0 tx=0x7fd6d4005d10 comp rx=0 tx=0).stop 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.705+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 msgr2=0x7fd6e41676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.705+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 0x7fd6e41676d0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6e000c6c0 tx=0x7fd6e000cb90 comp rx=0 tx=0).stop 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 shutdown_connections 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd6c00b56d0 0x7fd6c00d5b80 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6e41532b0 0x7fd6e41676d0 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6e410e6f0 0x7fd6e4162310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 --2- 10.20.193.175:0/2328291192 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6e410dd00 0x7fd6e4161dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 >> 10.20.193.175:0/2328291192 conn(0x7fd6e40e9710 msgr2=0x7fd6e4109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 shutdown_connections 2026-02-19T21:03:28.707 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:28.706+0000 7fd6ec0386c0 1 -- 10.20.193.175:0/2328291192 wait complete. 2026-02-19T21:03:28.745 DEBUG:teuthology.orchestra.run.trial175:osd.5> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.5.service 2026-02-19T21:03:28.748 INFO:tasks.cephadm:Deploying osd.6 on trial090 with /dev/vg_nvme/lv_2... 2026-02-19T21:03:28.748 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-19T21:03:28.877 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:03:28.980 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:03:28 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:03:28.844+0000 7f25cadf9780 -1 osd.5 0 log_to_monitors true 2026-02-19T21:03:29.353 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:03:29.371 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_2 --skip-validation 2026-02-19T21:03:29.496 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:03:29.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:29.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-19T21:03:29.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-19T21:03:29.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:29.545 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:29.545 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-19T21:03:29.546 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-19T21:03:29.547 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:29.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1933915043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88115220 msgr2=0x7fcf8811a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:29.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1933915043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88115220 0x7fcf8811a260 secure :-1 s=READY pgs=157 gs=1 cs=0 l=1 c_cookie=14460522417755457298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf700099a0 tx=0x7fcf7002ed20 comp rx=0 tx=0).stop 2026-02-19T21:03:29.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1933915043 shutdown_connections 2026-02-19T21:03:29.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1933915043 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcf8811aa40 0x7fcf8817b3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:29.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1933915043 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88115220 0x7fcf8811a260 unknown :-1 s=CLOSED pgs=157 gs=1 cs=0 l=1 c_cookie=14460522417755457298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1933915043 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcf88114830 0x7fcf88114c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1933915043 >> 10.20.193.90:0/1933915043 conn(0x7fcf8805ced0 msgr2=0x7fcf8805d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1933915043 shutdown_connections 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1933915043 wait complete. 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.617+0000 7fcf8d0c76c0 1 Processor -- start 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 -- start start 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 0x7fcf880fb4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcf8811aa40 0x7fcf8817b2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcf880fbaf0 0x7fcf88100dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcf880fc1e0 con 0x7fcf88114830 2026-02-19T21:03:29.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88101300 con 0x7fcf8811aa40 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcf881014c0 con 0x7fcf880fbaf0 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 0x7fcf880fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 0x7fcf880fb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43482/0 (socket says 10.20.193.90:43482) 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 -- 10.20.193.90:0/1830038308 learned_addr learned my addr 10.20.193.90:0/1830038308 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf875776c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcf880fbaf0 0x7fcf88100dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf865756c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcf8811aa40 0x7fcf8817b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 -- 10.20.193.90:0/1830038308 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcf880fbaf0 msgr2=0x7fcf88100dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcf880fbaf0 0x7fcf88100dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 -- 10.20.193.90:0/1830038308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcf8811aa40 msgr2=0x7fcf8817b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcf8811aa40 0x7fcf8817b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:29.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 -- 10.20.193.90:0/1830038308 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf70009590 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf86d766c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 0x7fcf880fb4c0 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf7c009490 tx=0x7fcf7c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf7c004a80 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcf7c009030 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf881017a0 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf7c00ce30 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.618+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf88101f30 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.619+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf88115b00 con 0x7fcf88114830 2026-02-19T21:03:29.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.620+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fcf7c004060 con 0x7fcf88114830 2026-02-19T21:03:29.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.620+0000 7fcf67fff6c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcf5c0b56d0 0x7fcf5c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:29.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.620+0000 7fcf865756c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcf5c0b56d0 0x7fcf5c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:29.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.620+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4208+0+0 (secure 0 0 0) 0x7fcf7c0e2b80 con 0x7fcf88114830 2026-02-19T21:03:29.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.621+0000 7fcf865756c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcf5c0b56d0 0x7fcf5c0d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf700092e0 tx=0x7fcf70005f20 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:29.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.621+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcf7c0a6510 con 0x7fcf88114830 2026-02-19T21:03:29.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:29.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:29.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:29.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:29.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-19T21:03:29.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-19T21:03:29.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:29.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:29.720+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fcf880fc610 con 0x7fcf5c0b56d0 2026-02-19T21:03:30.399 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.399 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: osdmap e32: 6 total, 5 up, 6 in 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:30.400 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:30.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:30.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:30.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-19T21:03:30.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: osdmap e32: 6 total, 5 up, 6 in 2026-02-19T21:03:30.500 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:30.501 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:30.502 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.503 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.503 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:30.503 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:30.503 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: osdmap e32: 6 total, 5 up, 6 in 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='client.14547 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:30.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:30.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:30.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:30.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:03:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:03:30.398+0000 7f25c6d1a6c0 -1 osd.5 0 waiting for initial osdmap 2026-02-19T21:03:30.767 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:03:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:03:30.401+0000 7f25bebe76c0 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1471689548' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff"} : dispatch 2026-02-19T21:03:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1471689548' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff"}]': finished 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: osdmap e33: 7 total, 5 up, 7 in 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/112704986' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:31 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:31.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1471689548' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff"} : dispatch 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1471689548' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff"}]': finished 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: osdmap e33: 7 total, 5 up, 7 in 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/112704986' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:31.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:31 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:31.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1471689548' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff"} : dispatch 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1471689548' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff"}]': finished 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: osdmap e33: 7 total, 5 up, 7 in 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/112704986' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:31.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:31 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] boot 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: osdmap e34: 7 total, 6 up, 7 in 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:32 trial090 ceph-mon[31759]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:32.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:32.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] boot 2026-02-19T21:03:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: osdmap e34: 7 total, 6 up, 7 in 2026-02-19T21:03:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:32.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:32 trial175 ceph-mon[34116]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:32.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: osd.5 [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] boot 2026-02-19T21:03:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: osdmap e34: 7 total, 6 up, 7 in 2026-02-19T21:03:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-19T21:03:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:32.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:32 trial105 ceph-mon[33883]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.462 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: osdmap e35: 7 total, 6 up, 7 in 2026-02-19T21:03:33.462 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: pgmap v76: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: pgmap v77: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:33.463 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.464 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-19T21:03:33.464 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.464 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:33 trial090 ceph-mon[31759]: pgmap v78: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: osdmap e35: 7 total, 6 up, 7 in 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: pgmap v76: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: pgmap v77: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-19T21:03:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:33 trial175 ceph-mon[34116]: pgmap v78: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: osdmap e35: 7 total, 6 up, 7 in 2026-02-19T21:03:33.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:33.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: pgmap v76: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: pgmap v77: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-19T21:03:33.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:33.897 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:33 trial105 ceph-mon[33883]: pgmap v78: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:34.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:34 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:34.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:34 trial090 ceph-mon[31759]: osdmap e36: 7 total, 6 up, 7 in 2026-02-19T21:03:34.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:34 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:34 trial175 ceph-mon[34116]: osdmap e36: 7 total, 6 up, 7 in 2026-02-19T21:03:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:34.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:34 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:34.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:34 trial105 ceph-mon[33883]: osdmap e36: 7 total, 6 up, 7 in 2026-02-19T21:03:34.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:35.465 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:35 trial090 ceph-mon[31759]: osdmap e37: 7 total, 6 up, 7 in 2026-02-19T21:03:35.466 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:35 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:35.466 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:35 trial090 ceph-mon[31759]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:35.466 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:35 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:35.466 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:35 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:35.466 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:35 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:35.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:35 trial175 ceph-mon[34116]: osdmap e37: 7 total, 6 up, 7 in 2026-02-19T21:03:35.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:35 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:35.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:35 trial175 ceph-mon[34116]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:35.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:35 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:35.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:35 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:35.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:35 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:35.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:35 trial105 ceph-mon[33883]: osdmap e37: 7 total, 6 up, 7 in 2026-02-19T21:03:35.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:35 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:35.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:35 trial105 ceph-mon[33883]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:35.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:35 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:35.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:35 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:35.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:35 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.116 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 6 on host 'trial090' 2026-02-19T21:03:36.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.114+0000 7fcf67fff6c0 1 -- 10.20.193.90:0/1830038308 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fcf880fc610 con 0x7fcf5c0b56d0 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcf5c0b56d0 msgr2=0x7fcf5c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcf5c0b56d0 0x7fcf5c0d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf700092e0 tx=0x7fcf70005f20 comp rx=0 tx=0).stop 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 msgr2=0x7fcf880fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 0x7fcf880fb4c0 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf7c009490 tx=0x7fcf7c00bca0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 shutdown_connections 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcf5c0b56d0 0x7fcf5c0d5b80 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcf880fbaf0 0x7fcf88100dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcf8811aa40 0x7fcf8817b2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 --2- 10.20.193.90:0/1830038308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcf88114830 0x7fcf880fb4c0 unknown :-1 s=CLOSED pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 >> 10.20.193.90:0/1830038308 conn(0x7fcf8805ced0 msgr2=0x7fcf88117020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:36.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 shutdown_connections 2026-02-19T21:03:36.120 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:36.117+0000 7fcf8d0c76c0 1 -- 10.20.193.90:0/1830038308 wait complete. 2026-02-19T21:03:36.160 DEBUG:teuthology.orchestra.run.trial090:osd.6> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.6.service 2026-02-19T21:03:36.163 INFO:tasks.cephadm:Deploying osd.7 on trial105 with /dev/vg_nvme/lv_2... 2026-02-19T21:03:36.163 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-19T21:03:36.290 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:03:36.406 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:03:36 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:03:36.231+0000 7f9c3866e780 -1 osd.6 0 log_to_monitors true 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: osdmap e38: 7 total, 6 up, 7 in 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.442 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.443 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:36 trial105 ceph-mon[33883]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-19T21:03:36.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: osdmap e38: 7 total, 6 up, 7 in 2026-02-19T21:03:36.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:36.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:36.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:36.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:36.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:36.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:36.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:36.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:36 trial090 ceph-mon[31759]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-19T21:03:36.730 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:03:36.746 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial105:vg_nvme/lv_2 --skip-validation 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: osdmap e38: 7 total, 6 up, 7 in 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:36 trial175 ceph-mon[34116]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-19T21:03:36.869 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:03:36.983 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.980+0000 7f35700816c0 1 -- 10.20.193.105:0/285572672 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f356810fbf0 msgr2=0x7f3568114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:36.983 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.980+0000 7f35700816c0 1 --2- 10.20.193.105:0/285572672 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f356810fbf0 0x7f3568114c30 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=15323721772001614755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f355c009970 tx=0x7f355c02ed50 comp rx=0 tx=0).stop 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- 10.20.193.105:0/285572672 shutdown_connections 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 --2- 10.20.193.105:0/285572672 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3568115410 0x7f3568175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 --2- 10.20.193.105:0/285572672 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f356810fbf0 0x7f3568114c30 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=15323721772001614755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 --2- 10.20.193.105:0/285572672 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f356810f200 0x7f356810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- 10.20.193.105:0/285572672 >> 10.20.193.105:0/285572672 conn(0x7f35680eca60 msgr2=0x7f356810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- 10.20.193.105:0/285572672 shutdown_connections 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- 10.20.193.105:0/285572672 wait complete. 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 Processor -- start 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- start start 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f356810f200 0x7f35680f4bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:36.984 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3568115410 0x7f3568175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 0x7f35680fa4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35680f5860 con 0x7f356810f200 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35680faa10 con 0x7f35680f5200 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f35700816c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35680fabd0 con 0x7f3568115410 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 0x7f35680fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 0x7f35680fa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.105:32830/0 (socket says 10.20.193.105:32830) 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 -- 10.20.193.105:0/3170366747 learned_addr learned my addr 10.20.193.105:0/3170366747 (peer_addr_for_me v2:10.20.193.105:0/0) 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356d5f16c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3568115410 0x7f3568175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356ddf26c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f356810f200 0x7f35680f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 -- 10.20.193.105:0/3170366747 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3568115410 msgr2=0x7f3568175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:36.985 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3568115410 0x7f3568175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 -- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f356810f200 msgr2=0x7f35680f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f356810f200 0x7f35680f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 -- 10.20.193.105:0/3170366747 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c009590 con 0x7f35680f5200 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.981+0000 7f356e5f36c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 0x7f35680fa4d0 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3564006ea0 tx=0x7f356400cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.982+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3564003a30 con 0x7f35680f5200 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.982+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f35640054f0 con 0x7f35680f5200 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.982+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35680fae50 con 0x7f35680f5200 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.982+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f356400dcd0 con 0x7f35680f5200 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.982+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35680fb330 con 0x7f35680f5200 2026-02-19T21:03:36.986 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.982+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35681104d0 con 0x7f35680f5200 2026-02-19T21:03:36.987 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.983+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f3564005030 con 0x7f35680f5200 2026-02-19T21:03:36.987 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.984+0000 7f3556ffd6c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35440b56d0 0x7f35440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:36.988 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.984+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4640+0+0 (secure 0 0 0) 0x7f35640e3e00 con 0x7f35680f5200 2026-02-19T21:03:36.988 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.984+0000 7f356ddf26c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35440b56d0 0x7f35440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:36.988 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.984+0000 7f356ddf26c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35440b56d0 0x7f35440d5b80 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3558004750 tx=0x7f3558005e60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:36.988 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:36.985+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f35640a75e0 con 0x7f35680f5200 2026-02-19T21:03:37.082 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:37.081+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f356810fbf0 con 0x7f35440b56d0 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:37.582 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: osdmap e39: 7 total, 6 up, 7 in 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.583 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.584 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:37.584 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.584 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:37.584 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:37.584 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:37.584 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:37 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.755 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: osdmap e39: 7 total, 6 up, 7 in 2026-02-19T21:03:37.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.757 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:37.758 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:37.758 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:37.758 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:37 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='client.24434 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: osdmap e39: 7 total, 6 up, 7 in 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:37.768 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:37 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:38.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:03:37 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:03:37.753+0000 7f9c3458f6c0 -1 osd.6 0 waiting for initial osdmap 2026-02-19T21:03:38.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:03:37 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:03:37.758+0000 7f9c2c45c6c0 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:38.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"} : dispatch 2026-02-19T21:03:38.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/2523373872' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"} : dispatch 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"}]': finished 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: osdmap e40: 8 total, 6 up, 8 in 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/3631267806' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:38.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:38 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:38.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"} : dispatch 2026-02-19T21:03:38.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/2523373872' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"} : dispatch 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"}]': finished 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: osdmap e40: 8 total, 6 up, 8 in 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/3631267806' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:38.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:38 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:38.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"} : dispatch 2026-02-19T21:03:38.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/2523373872' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"} : dispatch 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b119453-b94f-441f-8685-a992fe2922ad"}]': finished 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: osdmap e40: 8 total, 6 up, 8 in 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/3631267806' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:38 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:39.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:39.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:39.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] boot 2026-02-19T21:03:39.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: osdmap e41: 8 total, 7 up, 8 in 2026-02-19T21:03:39.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:39.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:39.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:39 trial105 ceph-mon[33883]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-19T21:03:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:40.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] boot 2026-02-19T21:03:40.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: osdmap e41: 8 total, 7 up, 8 in 2026-02-19T21:03:40.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:40.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:40.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:39 trial175 ceph-mon[34116]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-19T21:03:40.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: osd.6 [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] boot 2026-02-19T21:03:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: osdmap e41: 8 total, 7 up, 8 in 2026-02-19T21:03:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-19T21:03:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:40.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:39 trial090 ceph-mon[31759]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 165 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.002 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: osdmap e42: 8 total, 7 up, 8 in 2026-02-19T21:03:41.002 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:41.002 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 211 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.002 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-19T21:03:41.003 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:40 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: osdmap e42: 8 total, 7 up, 8 in 2026-02-19T21:03:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 211 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-19T21:03:41.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:40 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: osdmap e42: 8 total, 7 up, 8 in 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 211 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:41.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:41.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-19T21:03:41.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:40 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:41 trial175 ceph-mon[34116]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:41 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:42.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:41 trial105 ceph-mon[33883]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:42.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:41 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:42.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:41 trial090 ceph-mon[31759]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:42.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:41 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:43.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:43.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:43.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:43.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:43.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:43.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:43.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:43.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:43.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:43.345 INFO:teuthology.orchestra.run.trial105.stdout:Created osd(s) 7 on host 'trial105' 2026-02-19T21:03:43.346 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.343+0000 7f3556ffd6c0 1 -- 10.20.193.105:0/3170366747 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f356810fbf0 con 0x7f35440b56d0 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35440b56d0 msgr2=0x7f35440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35440b56d0 0x7f35440d5b80 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3558004750 tx=0x7f3558005e60 comp rx=0 tx=0).stop 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 msgr2=0x7f35680fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 0x7f35680fa4d0 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3564006ea0 tx=0x7f356400cca0 comp rx=0 tx=0).stop 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 shutdown_connections 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35440b56d0 0x7f35440d5b80 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35680f5200 0x7f35680fa4d0 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3568115410 0x7f3568175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 --2- 10.20.193.105:0/3170366747 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f356810f200 0x7f35680f4bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 >> 10.20.193.105:0/3170366747 conn(0x7f35680eca60 msgr2=0x7f3568113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 shutdown_connections 2026-02-19T21:03:43.348 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:43.346+0000 7f35700816c0 1 -- 10.20.193.105:0/3170366747 wait complete. 2026-02-19T21:03:43.387 DEBUG:teuthology.orchestra.run.trial105:osd.7> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.7.service 2026-02-19T21:03:43.389 INFO:tasks.cephadm:Deploying osd.8 on trial175 with /dev/vg_nvme/lv_2... 2026-02-19T21:03:43.389 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-19T21:03:43.515 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:03:43.557 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:03:43 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:03:43.444+0000 7efe43c38780 -1 osd.7 0 log_to_monitors true 2026-02-19T21:03:43.944 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:03:43.962 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial175:vg_nvme/lv_2 --skip-validation 2026-02-19T21:03:44.084 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:03:44.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-19T21:03:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:43 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:44.198 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-19T21:03:44.199 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:43 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:44.204 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 -- 10.20.193.175:0/2474794676 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 msgr2=0x7f69b4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:44.204 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/2474794676 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b4175db0 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=9890361713640010616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69b000aa70 tx=0x7f69b002fde0 comp rx=0 tx=0).stop 2026-02-19T21:03:44.204 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 -- 10.20.193.175:0/2474794676 shutdown_connections 2026-02-19T21:03:44.204 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/2474794676 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b4175db0 unknown :-1 s=CLOSED pgs=37 gs=1 cs=0 l=1 c_cookie=9890361713640010616 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:44.204 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/2474794676 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69b410fbf0 0x7f69b4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:44.204 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/2474794676 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 0x7f69b410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 -- 10.20.193.175:0/2474794676 >> 10.20.193.175:0/2474794676 conn(0x7f69b40ecac0 msgr2=0x7f69b410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 -- 10.20.193.175:0/2474794676 shutdown_connections 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.201+0000 7f69bbb446c0 1 -- 10.20.193.175:0/2474794676 wait complete. 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 Processor -- start 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 -- start start 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 0x7f69b411d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b411d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69b4122b30 0x7f69b4122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4123510 con 0x7f69b4122b30 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4123680 con 0x7f69b410f200 2026-02-19T21:03:44.205 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69bbb446c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4123840 con 0x7f69b4115410 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b411d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b411d770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.175:54644/0 (socket says 10.20.193.175:54644) 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 -- 10.20.193.175:0/4229425333 learned_addr learned my addr 10.20.193.175:0/4229425333 (peer_addr_for_me v2:10.20.193.175:0/0) 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b98b96c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 0x7f69b411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69ba0ba6c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69b4122b30 0x7f69b4122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 -- 10.20.193.175:0/4229425333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 msgr2=0x7f69b411d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 0x7f69b411d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 -- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69b4122b30 msgr2=0x7f69b4122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69b4122b30 0x7f69b4122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 -- 10.20.193.175:0/4229425333 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b000a660 con 0x7f69b4115410 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b98b96c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 0x7f69b411d230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:03:44.206 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.202+0000 7f69b90b86c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b411d770 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a800b650 tx=0x7f69a800bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:44.207 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.203+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a80044a0 con 0x7f69b4115410 2026-02-19T21:03:44.207 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.203+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f69a8009030 con 0x7f69b4115410 2026-02-19T21:03:44.207 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.203+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b4163cc0 con 0x7f69b4115410 2026-02-19T21:03:44.207 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.203+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a800cc10 con 0x7f69b4115410 2026-02-19T21:03:44.207 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.203+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b41641f0 con 0x7f69b4115410 2026-02-19T21:03:44.207 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.203+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b41104d0 con 0x7f69b4115410 2026-02-19T21:03:44.208 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.205+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f69a80026b0 con 0x7f69b4115410 2026-02-19T21:03:44.208 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.205+0000 7f69a2ffd6c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69900b56d0 0x7f69900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:44.208 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.205+0000 7f69b98b96c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69900b56d0 0x7f69900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:44.208 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.205+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5072+0+0 (secure 0 0 0) 0x7f69a80e2e90 con 0x7f69b4115410 2026-02-19T21:03:44.208 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.206+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69a80a64c0 con 0x7f69b4115410 2026-02-19T21:03:44.209 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.206+0000 7f69b98b96c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69900b56d0 0x7f69900d5b80 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a4004750 tx=0x7f69a4009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:44.304 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:44.304+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f69b411e3e0 con 0x7f69900b56d0 2026-02-19T21:03:44.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:44.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:44.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:44.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:44.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:44.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:44.408 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:44.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:44.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-19T21:03:44.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-19T21:03:44.409 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:43 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:45.308 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:03:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:03:44.975+0000 7efe3fb596c0 -1 osd.7 0 waiting for initial osdmap 2026-02-19T21:03:45.308 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:03:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:03:44.980+0000 7efe3ba2e6c0 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: osdmap e43: 8 total, 7 up, 8 in 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/651440885' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"}]': finished 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: osdmap e44: 9 total, 7 up, 9 in 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:45.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1301691880' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:45.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: osdmap e43: 8 total, 7 up, 8 in 2026-02-19T21:03:45.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/651440885' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"}]': finished 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: osdmap e44: 9 total, 7 up, 9 in 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:45.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.649 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1301691880' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: osdmap e43: 8 total, 7 up, 8 in 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/651440885' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fdfc8889-7eda-48ef-ae9d-5ec9cb798a56"}]': finished 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: osdmap e44: 9 total, 7 up, 9 in 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:45.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:45.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1301691880' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:46.583 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:46.583 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:46.583 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:46.583 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] boot 2026-02-19T21:03:46.584 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: osdmap e45: 9 total, 8 up, 9 in 2026-02-19T21:03:46.584 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:46.584 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:46 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] boot 2026-02-19T21:03:46.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: osdmap e45: 9 total, 8 up, 9 in 2026-02-19T21:03:46.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:46.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:46 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:46.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-19T21:03:46.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:46.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:46.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: osd.7 [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] boot 2026-02-19T21:03:46.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: osdmap e45: 9 total, 8 up, 9 in 2026-02-19T21:03:46.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-19T21:03:46.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:46 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:47.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:47.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:47.401 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: osdmap e46: 9 total, 8 up, 9 in 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:47.402 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:47 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: osdmap e46: 9 total, 8 up, 9 in 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:47 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: osdmap e46: 9 total, 8 up, 9 in 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:47.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:47 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:48.552 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: pgmap v101: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.553 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: pgmap v103: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.553 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: pgmap v104: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.553 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-19T21:03:48.553 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:48.553 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: osdmap e47: 9 total, 8 up, 9 in 2026-02-19T21:03:48.553 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:48 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: pgmap v101: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: pgmap v103: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: pgmap v104: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-19T21:03:48.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:48.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: osdmap e47: 9 total, 8 up, 9 in 2026-02-19T21:03:48.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:48 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:48.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: pgmap v101: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: pgmap v103: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: pgmap v104: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-19T21:03:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: osdmap e47: 9 total, 8 up, 9 in 2026-02-19T21:03:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:48 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:49.569 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:49 trial175 ceph-mon[34116]: pgmap v105: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:49.569 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:49 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:49.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:49 trial105 ceph-mon[33883]: pgmap v105: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:49.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:49 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:49.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:49 trial090 ceph-mon[31759]: pgmap v105: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:49.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:49 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:50.484 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:50 trial175 ceph-mon[34116]: osdmap e48: 9 total, 8 up, 9 in 2026-02-19T21:03:50.484 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:50 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:50.484 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:50 trial175 ceph-mon[34116]: pgmap v108: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:50.484 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:50 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:50.484 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:50 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:50.484 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:50 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:50 trial105 ceph-mon[33883]: osdmap e48: 9 total, 8 up, 9 in 2026-02-19T21:03:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:50 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:50 trial105 ceph-mon[33883]: pgmap v108: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:50 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:50.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:50 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:50.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:50 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:50.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:50 trial090 ceph-mon[31759]: osdmap e48: 9 total, 8 up, 9 in 2026-02-19T21:03:50.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:50 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:50.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:50 trial090 ceph-mon[31759]: pgmap v108: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:50.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:50 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:50.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:50 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:50.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:50 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:50.715 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.714+0000 7f69a2ffd6c0 1 -- 10.20.193.175:0/4229425333 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f69b411e3e0 con 0x7f69900b56d0 2026-02-19T21:03:50.716 INFO:teuthology.orchestra.run.trial175.stdout:Created osd(s) 8 on host 'trial175' 2026-02-19T21:03:50.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69900b56d0 msgr2=0x7f69900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:50.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69900b56d0 0x7f69900d5b80 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a4004750 tx=0x7f69a4009260 comp rx=0 tx=0).stop 2026-02-19T21:03:50.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 msgr2=0x7f69b411d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:50.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b411d770 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a800b650 tx=0x7f69a800bb20 comp rx=0 tx=0).stop 2026-02-19T21:03:50.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 shutdown_connections 2026-02-19T21:03:50.718 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69900b56d0 0x7f69900d5b80 unknown :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:50.719 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69b4122b30 0x7f69b4122fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:50.719 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69b4115410 0x7f69b411d770 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:50.719 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 --2- 10.20.193.175:0/4229425333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69b410f200 0x7f69b411d230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:50.719 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 >> 10.20.193.175:0/4229425333 conn(0x7f69b40ecac0 msgr2=0x7f69b410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:50.719 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 shutdown_connections 2026-02-19T21:03:50.719 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:03:50.717+0000 7f69bbb446c0 1 -- 10.20.193.175:0/4229425333 wait complete. 2026-02-19T21:03:50.761 DEBUG:teuthology.orchestra.run.trial175:osd.8> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.8.service 2026-02-19T21:03:50.763 INFO:tasks.cephadm:Deploying osd.9 on trial090 with /dev/vg_nvme/lv_1... 2026-02-19T21:03:50.763 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-19T21:03:50.887 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:03:50.988 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:03:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:03:50.815+0000 7ff3b96c3780 -1 osd.8 0 log_to_monitors true 2026-02-19T21:03:51.335 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:03:51.353 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial090:vg_nvme/lv_1 --skip-validation 2026-02-19T21:03:51.478 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:03:51.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: osdmap e49: 9 total, 8 up, 9 in 2026-02-19T21:03:51.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:51.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:51.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:51.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: pgmap v110: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:51.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:51.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:51.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:51.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-19T21:03:51.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-19T21:03:51.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:51.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:51 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:51.591 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: osdmap e49: 9 total, 8 up, 9 in 2026-02-19T21:03:51.591 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: pgmap v110: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.592 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.593 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-19T21:03:51.593 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-19T21:03:51.593 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:51.593 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:51 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:51.598 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.594+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/992143184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c113170 msgr2=0x7f710c173b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.594+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/992143184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c113170 0x7f710c173b10 secure :-1 s=READY pgs=166 gs=1 cs=0 l=1 c_cookie=2862380689259239231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f710000aa70 tx=0x7f710002fde0 comp rx=0 tx=0).stop 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/992143184 shutdown_connections 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/992143184 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c113170 0x7f710c173b10 unknown :-1 s=CLOSED pgs=166 gs=1 cs=0 l=1 c_cookie=2862380689259239231 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/992143184 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f710c10d950 0x7f710c112990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/992143184 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c10cf60 0x7f710c10d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/992143184 >> 10.20.193.90:0/992143184 conn(0x7f710c0ea840 msgr2=0x7f710c10ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/992143184 shutdown_connections 2026-02-19T21:03:51.599 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/992143184 wait complete. 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 Processor -- start 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- start start 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 0x7f710c11b080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c113170 0x7f710c11b5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f710c120980 0x7f710c120e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f710c121390 con 0x7f710c10cf60 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f710c121500 con 0x7f710c113170 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f7111d6d6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f710c1216c0 con 0x7f710c120980 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 0x7f710c11b080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 0x7f710c11b080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:46468/0 (socket says 10.20.193.90:46468) 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 -- 10.20.193.90:0/2558638763 learned_addr learned my addr 10.20.193.90:0/2558638763 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:03:51.600 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710bfff6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f710c120980 0x7f710c120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710affd6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c113170 0x7f710c11b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 -- 10.20.193.90:0/2558638763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f710c120980 msgr2=0x7f710c120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f710c120980 0x7f710c120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 -- 10.20.193.90:0/2558638763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c113170 msgr2=0x7f710c11b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c113170 0x7f710c11b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 -- 10.20.193.90:0/2558638763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710000a660 con 0x7f710c10cf60 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710affd6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c113170 0x7f710c11b5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.595+0000 7f710b7fe6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 0x7f710c11b080 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f80092e0 tx=0x7f70f800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.596+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70f8004250 con 0x7f710c10cf60 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.596+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f70f80043b0 con 0x7f710c10cf60 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.596+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710c161b70 con 0x7f710c10cf60 2026-02-19T21:03:51.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.596+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70f800cd40 con 0x7f710c10cf60 2026-02-19T21:03:51.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.596+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f710c162050 con 0x7f710c10cf60 2026-02-19T21:03:51.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.596+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f710c10e230 con 0x7f710c10cf60 2026-02-19T21:03:51.602 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.597+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f70f80026b0 con 0x7f710c10cf60 2026-02-19T21:03:51.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.598+0000 7f7108ff96c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f70e00b56d0 0x7f70e00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:51.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.598+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5504+0+0 (secure 0 0 0) 0x7f70f80e3050 con 0x7f710c10cf60 2026-02-19T21:03:51.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.598+0000 7f710affd6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f70e00b56d0 0x7f70e00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:51.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.598+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f70f80a64d0 con 0x7f710c10cf60 2026-02-19T21:03:51.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.598+0000 7f710affd6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f70e00b56d0 0x7f70e00d5b80 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f710c121a10 tx=0x7f70fc005d70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:51.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: osdmap e49: 9 total, 8 up, 9 in 2026-02-19T21:03:51.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:51.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: pgmap v110: 1 pgs: 1 remapped; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:51.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-19T21:03:51.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-19T21:03:51.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:51.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:51 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:51.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:51.695+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f710c11c230 con 0x7f70e00b56d0 2026-02-19T21:03:52.700 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:03:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:03:52.353+0000 7ff3b55e46c0 -1 osd.8 0 waiting for initial osdmap 2026-02-19T21:03:52.700 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:03:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:03:52.360+0000 7ff3ad4b16c0 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:03:52.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:52.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:52.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:52.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: osdmap e50: 9 total, 8 up, 9 in 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:52.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3584927147' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bfa36c36-03aa-4363-85f7-b4cd9450b612"} : dispatch 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3584927147' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfa36c36-03aa-4363-85f7-b4cd9450b612"}]': finished 2026-02-19T21:03:52.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: osdmap e51: 10 total, 8 up, 10 in 2026-02-19T21:03:52.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:52.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:52.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:52.910 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:52 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3630103939' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:53.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: osdmap e50: 9 total, 8 up, 9 in 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3584927147' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bfa36c36-03aa-4363-85f7-b4cd9450b612"} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3584927147' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfa36c36-03aa-4363-85f7-b4cd9450b612"}]': finished 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: osdmap e51: 10 total, 8 up, 10 in 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:53.019 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:53.020 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:53.020 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:52 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3630103939' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='client.14613 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial090:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-19T21:03:53.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: osdmap e50: 9 total, 8 up, 9 in 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:53.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3584927147' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bfa36c36-03aa-4363-85f7-b4cd9450b612"} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3584927147' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfa36c36-03aa-4363-85f7-b4cd9450b612"}]': finished 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: osdmap e51: 10 total, 8 up, 10 in 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:53.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:53.149 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:52 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3630103939' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:03:54.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:53 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:54.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:53 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:03:54.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:53 trial175 ceph-mon[34116]: osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] boot 2026-02-19T21:03:54.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:53 trial175 ceph-mon[34116]: osdmap e52: 10 total, 9 up, 10 in 2026-02-19T21:03:54.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:54.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:53 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:54.043 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:53 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:54.044 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:53 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:03:54.044 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:53 trial090 ceph-mon[31759]: osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] boot 2026-02-19T21:03:54.044 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:53 trial090 ceph-mon[31759]: osdmap e52: 10 total, 9 up, 10 in 2026-02-19T21:03:54.044 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:54.044 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:53 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:54.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:53 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:03:54.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:53 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:03:54.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:53 trial105 ceph-mon[33883]: osd.8 [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] boot 2026-02-19T21:03:54.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:53 trial105 ceph-mon[33883]: osdmap e52: 10 total, 9 up, 10 in 2026-02-19T21:03:54.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-19T21:03:54.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:53 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:54.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:03:54.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:03:54.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:54.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: osdmap e53: 10 total, 9 up, 10 in 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:54.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:54.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:54.909 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:54 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:55.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: osdmap e53: 10 total, 9 up, 10 in 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:55.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:55.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:55.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:55.018 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:54 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:55.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: osdmap e53: 10 total, 9 up, 10 in 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:55.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:55.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:55.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:55.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:54 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: osdmap e54: 10 total, 9 up, 10 in 2026-02-19T21:03:55.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:55 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:56.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:56.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:56.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-19T21:03:56.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:56.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:56.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: osdmap e54: 10 total, 9 up, 10 in 2026-02-19T21:03:56.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:55 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:56.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:56.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:56.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-19T21:03:56.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:56.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:03:56.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: osdmap e54: 10 total, 9 up, 10 in 2026-02-19T21:03:56.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:55 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:57.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:56 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:57.085 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:56 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:57.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:56 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:03:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:57 trial090 ceph-mon[31759]: osdmap e55: 10 total, 9 up, 10 in 2026-02-19T21:03:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:57 trial090 ceph-mon[31759]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 205 KiB/s, 0 objects/s recovering 2026-02-19T21:03:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:57.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:57 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:57 trial175 ceph-mon[34116]: osdmap e55: 10 total, 9 up, 10 in 2026-02-19T21:03:58.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:58.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:57 trial175 ceph-mon[34116]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 205 KiB/s, 0 objects/s recovering 2026-02-19T21:03:58.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:58.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:57 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:57 trial105 ceph-mon[33883]: osdmap e55: 10 total, 9 up, 10 in 2026-02-19T21:03:58.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:58.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:57 trial105 ceph-mon[33883]: pgmap v123: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 205 KiB/s, 0 objects/s recovering 2026-02-19T21:03:58.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:58.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:57 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.219 INFO:teuthology.orchestra.run.trial090.stdout:Created osd(s) 9 on host 'trial090' 2026-02-19T21:03:58.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.217+0000 7f7108ff96c0 1 -- 10.20.193.90:0/2558638763 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f710c11c230 con 0x7f70e00b56d0 2026-02-19T21:03:58.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f70e00b56d0 msgr2=0x7f70e00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f70e00b56d0 0x7f70e00d5b80 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f710c121a10 tx=0x7f70fc005d70 comp rx=0 tx=0).stop 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 msgr2=0x7f710c11b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 0x7f710c11b080 secure :-1 s=READY pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f80092e0 tx=0x7f70f800bc50 comp rx=0 tx=0).stop 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 shutdown_connections 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f70e00b56d0 0x7f70e00d5b80 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f710c120980 0x7f710c120e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f710c113170 0x7f710c11b5c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:58.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 --2- 10.20.193.90:0/2558638763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f710c10cf60 0x7f710c11b080 unknown :-1 s=CLOSED pgs=167 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:58.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 >> 10.20.193.90:0/2558638763 conn(0x7f710c0ea840 msgr2=0x7f710c10ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:58.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 shutdown_connections 2026-02-19T21:03:58.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:03:58.220+0000 7f7111d6d6c0 1 -- 10.20.193.90:0/2558638763 wait complete. 2026-02-19T21:03:58.267 DEBUG:teuthology.orchestra.run.trial090:osd.9> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.9.service 2026-02-19T21:03:58.269 INFO:tasks.cephadm:Deploying osd.10 on trial105 with /dev/vg_nvme/lv_1... 2026-02-19T21:03:58.270 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-19T21:03:58.396 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:03:58.657 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:03:58 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:03:58.350+0000 7fecaf727780 -1 osd.9 0 log_to_monitors true 2026-02-19T21:03:58.808 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: osdmap e56: 10 total, 9 up, 10 in 2026-02-19T21:03:58.808 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:58.808 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.808 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-19T21:03:58.809 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:03:58 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:58.853 INFO:teuthology.orchestra.run.trial105.stdout: 2026-02-19T21:03:58.869 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial105:vg_nvme/lv_1 --skip-validation 2026-02-19T21:03:58.993 INFO:teuthology.orchestra.run.trial105.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.b/config 2026-02-19T21:03:59.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: osdmap e56: 10 total, 9 up, 10 in 2026-02-19T21:03:59.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:59.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-19T21:03:59.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:03:58 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:59.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/1029273000 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff4010fbf0 msgr2=0x7eff40114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:59.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/1029273000 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff4010fbf0 0x7eff40114c30 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=16445094440330917439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff34009970 tx=0x7eff3402ed20 comp rx=0 tx=0).stop 2026-02-19T21:03:59.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/1029273000 shutdown_connections 2026-02-19T21:03:59.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/1029273000 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7eff40115410 0x7eff40175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:59.122 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/1029273000 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff4010fbf0 0x7eff40114c30 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=16445094440330917439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/1029273000 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7eff4010f200 0x7eff4010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/1029273000 >> 10.20.193.105:0/1029273000 conn(0x7eff400ecac0 msgr2=0x7eff4010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/1029273000 shutdown_connections 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/1029273000 wait complete. 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 Processor -- start 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.119+0000 7eff47dbb6c0 1 -- start start 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7eff4010f200 0x7eff400f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7eff40115410 0x7eff40175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 0x7eff400fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff400f59b0 con 0x7eff4010f200 2026-02-19T21:03:59.123 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff400faad0 con 0x7eff400f52c0 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff400fac90 con 0x7eff40115410 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 0x7eff400fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 0x7eff400fa590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.105:42998/0 (socket says 10.20.193.105:42998) 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 -- 10.20.193.105:0/2338823294 learned_addr learned my addr 10.20.193.105:0/2338823294 (peer_addr_for_me v2:10.20.193.105:0/0) 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4532b6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7eff40115410 0x7eff40175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff45b2c6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7eff4010f200 0x7eff400f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 -- 10.20.193.105:0/2338823294 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7eff40115410 msgr2=0x7eff40175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7eff40115410 0x7eff40175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 -- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7eff4010f200 msgr2=0x7eff400f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7eff4010f200 0x7eff400f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 -- 10.20.193.105:0/2338823294 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff34009590 con 0x7eff400f52c0 2026-02-19T21:03:59.124 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff4632d6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 0x7eff400fa590 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff3c00c6f0 tx=0x7eff3c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:59.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff3c003c40 con 0x7eff400f52c0 2026-02-19T21:03:59.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7eff3c00a030 con 0x7eff400f52c0 2026-02-19T21:03:59.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff400faf70 con 0x7eff400f52c0 2026-02-19T21:03:59.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7eff3c00dc10 con 0x7eff400f52c0 2026-02-19T21:03:59.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff400fb700 con 0x7eff400f52c0 2026-02-19T21:03:59.125 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.120+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff401104d0 con 0x7eff400f52c0 2026-02-19T21:03:59.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.122+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7eff3c005030 con 0x7eff400f52c0 2026-02-19T21:03:59.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.123+0000 7eff2effd6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7eff1c0b56d0 0x7eff1c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:03:59.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.123+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5936+0+0 (secure 0 0 0) 0x7eff3c0e40f0 con 0x7eff400f52c0 2026-02-19T21:03:59.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.123+0000 7eff45b2c6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7eff1c0b56d0 0x7eff1c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:03:59.126 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.123+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7eff3c0a73c0 con 0x7eff400f52c0 2026-02-19T21:03:59.127 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.123+0000 7eff45b2c6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7eff1c0b56d0 0x7eff1c0d5b80 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff30005980 tx=0x7eff30005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:03:59.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: osdmap e56: 10 total, 9 up, 10 in 2026-02-19T21:03:59.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:03:59.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:59.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-19T21:03:59.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:03:58 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:03:59.221 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:03:59.220+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7eff40052a30 con 0x7eff1c0b56d0 2026-02-19T21:04:00.156 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:03:59 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:03:59.865+0000 7fecab6486c0 -1 osd.9 0 waiting for initial osdmap 2026-02-19T21:04:00.157 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:03:59 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:03:59.871+0000 7feca35156c0 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: pgmap v126: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 173 KiB/s, 0 objects/s recovering 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: osdmap e57: 10 total, 9 up, 10 in 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.397 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: pgmap v128: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/2500004215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"}]': finished 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: osdmap e58: 11 total, 9 up, 11 in 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:00.398 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.399 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:00 trial105 ceph-mon[33883]: from='client.? 10.20.193.105:0/2143354500' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:04:00.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: pgmap v126: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 173 KiB/s, 0 objects/s recovering 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: osdmap e57: 10 total, 9 up, 10 in 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:00.518 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: pgmap v128: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/2500004215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"}]': finished 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: osdmap e58: 11 total, 9 up, 11 in 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:00.519 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.520 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:00 trial175 ceph-mon[34116]: from='client.? 10.20.193.105:0/2143354500' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:04:00.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: pgmap v126: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 173 KiB/s, 0 objects/s recovering 2026-02-19T21:04:00.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-19T21:04:00.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: osdmap e57: 10 total, 9 up, 10 in 2026-02-19T21:04:00.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial090", "root=default"]} : dispatch 2026-02-19T21:04:00.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial105:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: pgmap v128: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:00.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"} : dispatch 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/2500004215' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"} : dispatch 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial090", "root=default"]}]': finished 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "43e47e1a-7160-446c-8fe3-8a20cc2a4c3a"}]': finished 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: osdmap e58: 11 total, 9 up, 11 in 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:00.660 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:00 trial090 ceph-mon[31759]: from='client.? 10.20.193.105:0/2143354500' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:04:01.471 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:01 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:01.472 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:01 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:04:01.472 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:01 trial105 ceph-mon[33883]: osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] boot 2026-02-19T21:04:01.472 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:01 trial105 ceph-mon[33883]: osdmap e59: 11 total, 10 up, 11 in 2026-02-19T21:04:01.472 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:01.472 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:01 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:01.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:01 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:01.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:01 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:04:01.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:01 trial175 ceph-mon[34116]: osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] boot 2026-02-19T21:04:01.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:01 trial175 ceph-mon[34116]: osdmap e59: 11 total, 10 up, 11 in 2026-02-19T21:04:01.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:01.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:01 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:01.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:01 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:01 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:04:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:01 trial090 ceph-mon[31759]: osd.9 [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] boot 2026-02-19T21:04:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:01 trial090 ceph-mon[31759]: osdmap e59: 11 total, 10 up, 11 in 2026-02-19T21:04:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-19T21:04:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:01 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:02.286 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:02 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-19T21:04:02.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:04:02.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:02.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:02 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:02.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:02.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:02.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:02.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:02.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:02.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:02 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-19T21:04:03.334 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:03 trial105 ceph-mon[33883]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:03.334 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:03 trial105 ceph-mon[33883]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:03.334 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:03 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:03.334 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:03 trial105 ceph-mon[33883]: osdmap e60: 11 total, 10 up, 11 in 2026-02-19T21:04:03.334 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:03 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:03.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:03 trial175 ceph-mon[34116]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:03.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:03 trial175 ceph-mon[34116]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:03.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:03 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:03.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:03 trial175 ceph-mon[34116]: osdmap e60: 11 total, 10 up, 11 in 2026-02-19T21:04:03.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:03 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:03 trial090 ceph-mon[31759]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:03 trial090 ceph-mon[31759]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:03 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:03 trial090 ceph-mon[31759]: osdmap e60: 11 total, 10 up, 11 in 2026-02-19T21:04:03.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:03 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:04.488 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:04 trial105 ceph-mon[33883]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:04.488 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:04 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:04.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:04 trial175 ceph-mon[34116]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:04.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:04 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:04.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:04 trial090 ceph-mon[31759]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:04.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:04 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:05.500 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:05.501 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:05.502 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:05 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:05.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:05.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:05.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:05.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:05.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:05.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:05 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:05.547 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.546+0000 7eff2effd6c0 1 -- 10.20.193.105:0/2338823294 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7eff40052a30 con 0x7eff1c0b56d0 2026-02-19T21:04:05.548 INFO:teuthology.orchestra.run.trial105.stdout:Created osd(s) 10 on host 'trial105' 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7eff1c0b56d0 msgr2=0x7eff1c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7eff1c0b56d0 0x7eff1c0d5b80 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff30005980 tx=0x7eff30005910 comp rx=0 tx=0).stop 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 msgr2=0x7eff400fa590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 0x7eff400fa590 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7eff3c00c6f0 tx=0x7eff3c00cbc0 comp rx=0 tx=0).stop 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 shutdown_connections 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7eff1c0b56d0 0x7eff1c0d5b80 unknown :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:05.551 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7eff400f52c0 0x7eff400fa590 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:05.552 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7eff40115410 0x7eff40175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:05.552 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 --2- 10.20.193.105:0/2338823294 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7eff4010f200 0x7eff400f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:05.552 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 >> 10.20.193.105:0/2338823294 conn(0x7eff400ecac0 msgr2=0x7eff4010d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:05.552 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 shutdown_connections 2026-02-19T21:04:05.552 INFO:teuthology.orchestra.run.trial105.stderr:2026-02-19T21:04:05.549+0000 7eff47dbb6c0 1 -- 10.20.193.105:0/2338823294 wait complete. 2026-02-19T21:04:05.593 DEBUG:teuthology.orchestra.run.trial105:osd.10> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.10.service 2026-02-19T21:04:05.596 INFO:tasks.cephadm:Deploying osd.11 on trial175 with /dev/vg_nvme/lv_1... 2026-02-19T21:04:05.596 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:05.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:05.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:05.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:05.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:05 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:05.726 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:04:06.202 INFO:teuthology.orchestra.run.trial175.stdout: 2026-02-19T21:04:06.220 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch daemon add osd trial175:vg_nvme/lv_1 --skip-validation 2026-02-19T21:04:06.346 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:04:06.391 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: from='osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-19T21:04:06.392 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:06 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:06.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:06.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:06.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:06.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:04:06.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:06.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:06.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-19T21:04:06.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: from='osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-19T21:04:06.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:06 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 -- 10.20.193.175:0/973000158 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 msgr2=0x7fc19810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/973000158 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19810f5d0 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=7608135657048307136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc1840099a0 tx=0x7fc18402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 -- 10.20.193.175:0/973000158 shutdown_connections 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/973000158 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc198115410 0x7fc198175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/973000158 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc19810fbf0 0x7fc198114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/973000158 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19810f5d0 unknown :-1 s=CLOSED pgs=46 gs=1 cs=0 l=1 c_cookie=7608135657048307136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 -- 10.20.193.175:0/973000158 >> 10.20.193.175:0/973000158 conn(0x7fc1980ecac0 msgr2=0x7fc19810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:06.467 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 -- 10.20.193.175:0/973000158 shutdown_connections 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.464+0000 7fc19e2196c0 1 -- 10.20.193.175:0/973000158 wait complete. 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 Processor -- start 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 -- start start 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19811d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc198115410 0x7fc19811d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc198122b40 0x7fc198122fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc198123520 con 0x7fc198115410 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc198123690 con 0x7fc198122b40 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc198123850 con 0x7fc19810f200 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19811d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:06.468 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19811d240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.175:32788/0 (socket says 10.20.193.175:32788) 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 -- 10.20.193.175:0/794993281 learned_addr learned my addr 10.20.193.175:0/794993281 (peer_addr_for_me v2:10.20.193.175:0/0) 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc197fff6c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc198122b40 0x7fc198122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 -- 10.20.193.175:0/794993281 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc198122b40 msgr2=0x7fc198122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc198122b40 0x7fc198122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 -- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc198115410 msgr2=0x7fc19811d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc198115410 0x7fc19811d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 -- 10.20.193.175:0/794993281 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc184009590 con 0x7fc19810f200 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc1977fe6c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19811d240 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18402f230 tx=0x7fc18402fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc184002ba0 con 0x7fc19810f200 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc184002d00 con 0x7fc19810f200 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc198163cd0 con 0x7fc19810f200 2026-02-19T21:04:06.469 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1840372f0 con 0x7fc19810f200 2026-02-19T21:04:06.470 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.465+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1981641a0 con 0x7fc19810f200 2026-02-19T21:04:06.470 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.466+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1981104d0 con 0x7fc19810f200 2026-02-19T21:04:06.471 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.467+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fc1840078d0 con 0x7fc19810f200 2026-02-19T21:04:06.471 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.468+0000 7fc194ff96c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc16c0b56d0 0x7fc16c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:06.471 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.468+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6368+0+0 (secure 0 0 0) 0x7fc184107540 con 0x7fc19810f200 2026-02-19T21:04:06.471 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.468+0000 7fc196ffd6c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc16c0b56d0 0x7fc16c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:06.471 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.468+0000 7fc196ffd6c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc16c0b56d0 0x7fc16c0d5b80 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc188005dc0 tx=0x7fc188005d30 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:06.471 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.468+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc1840ca730 con 0x7fc19810f200 2026-02-19T21:04:06.563 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:06.563+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fc19811e420 con 0x7fc16c0b56d0 2026-02-19T21:04:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: from='osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-19T21:04:06.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:06 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:07.335 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: osdmap e61: 11 total, 10 up, 11 in 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.336 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.337 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1329240044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"}]': finished 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: osdmap e62: 12 total, 10 up, 12 in 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.338 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:07.339 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:07 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: osdmap e61: 11 total, 10 up, 11 in 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:07.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1329240044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"}]': finished 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: osdmap e62: 12 total, 10 up, 12 in 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:07.648 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:07 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.649 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:04:07 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:04:07.220+0000 7fb4ec3196c0 -1 osd.10 0 waiting for initial osdmap 2026-02-19T21:04:07.649 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:04:07 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:04:07.226+0000 7fb4e41e66c0 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: osdmap e61: 11 total, 10 up, 11 in 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]} : dispatch 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"} : dispatch 2026-02-19T21:04:07.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1329240044' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"} : dispatch 2026-02-19T21:04:07.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial105", "root=default"]}]': finished 2026-02-19T21:04:07.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b789e6a7-be92-4cae-a3a0-d6eebe9b8629"}]': finished 2026-02-19T21:04:07.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: osdmap e62: 12 total, 10 up, 12 in 2026-02-19T21:04:07.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:07.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:07.659 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:07 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:08.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: from='client.? 10.20.193.175:0/1504008368' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] boot 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: osdmap e63: 12 total, 11 up, 12 in 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:08.517 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:08 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:08.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: from='client.? 10.20.193.175:0/1504008368' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] boot 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: osdmap e63: 12 total, 11 up, 12 in 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:08.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:08 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:08.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: from='client.24520 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial175:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:08.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-19T21:04:08.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: from='client.? 10.20.193.175:0/1504008368' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-19T21:04:08.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:08.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:04:08.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: osd.10 [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] boot 2026-02-19T21:04:08.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: osdmap e63: 12 total, 11 up, 12 in 2026-02-19T21:04:08.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-19T21:04:08.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:08 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:09.408 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:09 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:04:09.409 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:09 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:04:09.409 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:09 trial175 ceph-mon[34116]: osdmap e64: 12 total, 11 up, 12 in 2026-02-19T21:04:09.409 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:09 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:09.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:09 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:04:09.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:09 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:04:09.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:09 trial105 ceph-mon[33883]: osdmap e64: 12 total, 11 up, 12 in 2026-02-19T21:04:09.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:09 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:09.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:09 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:04:09.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:09 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:04:09.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:09 trial090 ceph-mon[31759]: osdmap e64: 12 total, 11 up, 12 in 2026-02-19T21:04:09.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:09 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.457 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: osdmap e65: 12 total, 11 up, 12 in 2026-02-19T21:04:10.458 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:10 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:10.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:10.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:10.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-19T21:04:10.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: osdmap e65: 12 total, 11 up, 12 in 2026-02-19T21:04:10.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:10 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:10.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:10.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:10.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:10.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-19T21:04:10.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:10.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: osdmap e65: 12 total, 11 up, 12 in 2026-02-19T21:04:10.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:10 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:11.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:11 trial105 ceph-mon[33883]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:11.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:11 trial105 ceph-mon[33883]: osdmap e66: 12 total, 11 up, 12 in 2026-02-19T21:04:11.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:11 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:11.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:11 trial090 ceph-mon[31759]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:11.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:11 trial090 ceph-mon[31759]: osdmap e66: 12 total, 11 up, 12 in 2026-02-19T21:04:11.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:11 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:11.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:11 trial175 ceph-mon[34116]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:11.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:11 trial175 ceph-mon[34116]: osdmap e66: 12 total, 11 up, 12 in 2026-02-19T21:04:11.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:11 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:12.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:12.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:12.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:12.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:12 trial105 ceph-mon[33883]: osdmap e67: 12 total, 11 up, 12 in 2026-02-19T21:04:12.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:12 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:12.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:12.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:12.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:12.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:12 trial090 ceph-mon[31759]: osdmap e67: 12 total, 11 up, 12 in 2026-02-19T21:04:12.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:12 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:12.718 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:12.718 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:12.718 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:12.718 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:12 trial175 ceph-mon[34116]: osdmap e67: 12 total, 11 up, 12 in 2026-02-19T21:04:12.719 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:12 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:12.913 INFO:teuthology.orchestra.run.trial175.stdout:Created osd(s) 11 on host 'trial175' 2026-02-19T21:04:12.913 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.913+0000 7fc194ff96c0 1 -- 10.20.193.175:0/794993281 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc188009020 con 0x7fc16c0b56d0 2026-02-19T21:04:12.916 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc16c0b56d0 msgr2=0x7fc16c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc16c0b56d0 0x7fc16c0d5b80 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc188005dc0 tx=0x7fc188005d30 comp rx=0 tx=0).stop 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 msgr2=0x7fc19811d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19811d240 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc18402f230 tx=0x7fc18402fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 shutdown_connections 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc16c0b56d0 0x7fc16c0d5b80 unknown :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc198122b40 0x7fc198122fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc198115410 0x7fc19811d780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 --2- 10.20.193.175:0/794993281 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc19810f200 0x7fc19811d240 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 >> 10.20.193.175:0/794993281 conn(0x7fc1980ecac0 msgr2=0x7fc19810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 shutdown_connections 2026-02-19T21:04:12.917 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:12.916+0000 7fc19e2196c0 1 -- 10.20.193.175:0/794993281 wait complete. 2026-02-19T21:04:12.958 DEBUG:teuthology.orchestra.run.trial175:osd.11> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.11.service 2026-02-19T21:04:12.960 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-19T21:04:12.960 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T21:04:13.086 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:13.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 -- 10.20.193.90:0/185224011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 msgr2=0x7f1740175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:13.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/185224011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175db0 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=115523932171046839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f173c00aa70 tx=0x7f173c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 -- 10.20.193.90:0/185224011 shutdown_connections 2026-02-19T21:04:13.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/185224011 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175db0 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=115523932171046839 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/185224011 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010fbf0 0x7f1740114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/185224011 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f174010f200 0x7f174010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 -- 10.20.193.90:0/185224011 >> 10.20.193.90:0/185224011 conn(0x7f17400eca60 msgr2=0x7f174010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 -- 10.20.193.90:0/185224011 shutdown_connections 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 -- 10.20.193.90:0/185224011 wait complete. 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.197+0000 7f1747ec36c0 1 Processor -- start 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 -- start start 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 0x7f17400f4ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f17400f50e0 0x7f17400fa3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17400f57d0 con 0x7f1740115410 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17400fa8f0 con 0x7f174010f200 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17400faab0 con 0x7f17400f50e0 2026-02-19T21:04:13.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f17454336c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 0x7f17400f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 0x7f17400f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:50336/0 (socket says 10.20.193.90:50336) 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 -- 10.20.193.90:0/3387304924 learned_addr learned my addr 10.20.193.90:0/3387304924 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f17454336c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58344/0 (socket says 10.20.193.90:58344) 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f17464356c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f17400f50e0 0x7f17400fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 -- 10.20.193.90:0/3387304924 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f17400f50e0 msgr2=0x7f17400fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f17400f50e0 0x7f17400fa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 -- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 msgr2=0x7f1740175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 -- 10.20.193.90:0/3387304924 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c00a660 con 0x7f174010f200 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1745c346c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 0x7f17400f4ab0 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f173000b6f0 tx=0x7f173000bbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:13.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f17300044a0 con 0x7f174010f200 2026-02-19T21:04:13.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1730009030 con 0x7f174010f200 2026-02-19T21:04:13.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f173000cbe0 con 0x7f174010f200 2026-02-19T21:04:13.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17400fad90 con 0x7f174010f200 2026-02-19T21:04:13.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.198+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17400fb520 con 0x7f174010f200 2026-02-19T21:04:13.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.199+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17401104d0 con 0x7f174010f200 2026-02-19T21:04:13.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.200+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f1730005080 con 0x7f174010f200 2026-02-19T21:04:13.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.201+0000 7f172effd6c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f171c0b5650 0x7f171c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:13.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.201+0000 7f17454336c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f171c0b5650 0x7f171c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:13.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.201+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6801+0+0 (secure 0 0 0) 0x7f17300e3410 con 0x7f174010f200 2026-02-19T21:04:13.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.201+0000 7f17454336c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f171c0b5650 0x7f171c0d5b00 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17400fb440 tx=0x7f1734009290 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:13.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.201+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f17300a63e0 con 0x7f174010f200 2026-02-19T21:04:13.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.293+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f17400f5c00 con 0x7f174010f200 2026-02-19T21:04:13.295 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.293+0000 7f172effd6c0 1 -- 10.20.193.90:0/3387304924 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7f17300a9500 con 0x7f174010f200 2026-02-19T21:04:13.295 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:13.296 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f171c0b5650 msgr2=0x7f171c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:13.296 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f171c0b5650 0x7f171c0d5b00 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f17400fb440 tx=0x7f1734009290 comp rx=0 tx=0).stop 2026-02-19T21:04:13.296 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 msgr2=0x7f17400f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:13.296 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 0x7f17400f4ab0 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f173000b6f0 tx=0x7f173000bbc0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.296 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 shutdown_connections 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f171c0b5650 0x7f171c0d5b00 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f17400f50e0 0x7f17400fa3b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1740115410 0x7f1740175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 --2- 10.20.193.90:0/3387304924 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f174010f200 0x7f17400f4ab0 unknown :-1 s=CLOSED pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 >> 10.20.193.90:0/3387304924 conn(0x7f17400eca60 msgr2=0x7f174010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 shutdown_connections 2026-02-19T21:04:13.297 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:13.294+0000 7f1747ec36c0 1 -- 10.20.193.90:0/3387304924 wait complete. 2026-02-19T21:04:13.356 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1771535048,"num_in_osds":12,"osd_in_since":1771535047,"num_remapped_pgs":0} 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: pgmap v150: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 220 KiB/s, 0 objects/s recovering 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:13.549 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:13.550 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.550 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.550 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-19T21:04:13.550 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-19T21:04:13.550 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:13.550 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:13 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3387304924' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: pgmap v150: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 220 KiB/s, 0 objects/s recovering 2026-02-19T21:04:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-19T21:04:13.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:13.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:13 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3387304924' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: pgmap v150: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 220 KiB/s, 0 objects/s recovering 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:13.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:13 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3387304924' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:14.356 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T21:04:14.424 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: pgmap v152: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-19T21:04:14.424 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: pgmap v153: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 172 KiB/s, 0 objects/s recovering 2026-02-19T21:04:14.424 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-19T21:04:14.424 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: osdmap e68: 12 total, 11 up, 12 in 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:14.425 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:14 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:14.483 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:14.548 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: pgmap v152: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-19T21:04:14.548 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: pgmap v153: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 172 KiB/s, 0 objects/s recovering 2026-02-19T21:04:14.548 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-19T21:04:14.548 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: osdmap e68: 12 total, 11 up, 12 in 2026-02-19T21:04:14.548 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.549 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.550 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.550 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:14.550 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:14.550 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.550 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:14.550 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:14.551 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:14 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:14.611 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/3923990188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c010fbf0 msgr2=0x7fd6c0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:14.611 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/3923990188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c010fbf0 0x7fd6c0114c30 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=15552992244708629009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6b40099a0 tx=0x7fd6b402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:14.611 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/3923990188 shutdown_connections 2026-02-19T21:04:14.611 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/3923990188 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 0x7fd6c0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.611 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/3923990188 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c010fbf0 0x7fd6c0114c30 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=15552992244708629009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/3923990188 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 0x7fd6c010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/3923990188 >> 10.20.193.90:0/3923990188 conn(0x7fd6c00ecac0 msgr2=0x7fd6c010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/3923990188 shutdown_connections 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.607+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/3923990188 wait complete. 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 Processor -- start 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 -- start start 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 0x7fd6c00f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 0x7fd6c0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 0x7fd6c00fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c00f5950 con 0x7fd6c00f5260 2026-02-19T21:04:14.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c00faa70 con 0x7fd6c010f200 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c00fac30 con 0x7fd6c0115410 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 0x7fd6c00fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 0x7fd6c00fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41280/0 (socket says 10.20.193.90:41280) 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 -- 10.20.193.90:0/58138911 learned_addr learned my addr 10.20.193.90:0/58138911 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c65596c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 0x7fd6c00f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c5d586c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 0x7fd6c0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 -- 10.20.193.90:0/58138911 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 msgr2=0x7fd6c0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 0x7fd6c0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 -- 10.20.193.90:0/58138911 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 msgr2=0x7fd6c00f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 0x7fd6c00f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 -- 10.20.193.90:0/58138911 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b4009590 con 0x7fd6c00f5260 2026-02-19T21:04:14.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c65596c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 0x7fd6c00f4c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c5d586c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 0x7fd6c0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c6d5a6c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 0x7fd6c00fa530 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc00c6c0 tx=0x7fd6bc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc003c40 con 0x7fd6c00f5260 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd6bc00a030 con 0x7fd6c00f5260 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c00faf10 con 0x7fd6c00f5260 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6bc00db70 con 0x7fd6c00f5260 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.608+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c00fb6a0 con 0x7fd6c00f5260 2026-02-19T21:04:14.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.609+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c00fb3f0 con 0x7fd6c00f5260 2026-02-19T21:04:14.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.610+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fd6bc005030 con 0x7fd6c00f5260 2026-02-19T21:04:14.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.611+0000 7fd6a77fe6c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd69c0b56d0 0x7fd69c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:14.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.611+0000 7fd6c65596c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd69c0b56d0 0x7fd69c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:14.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.611+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6823+0+0 (secure 0 0 0) 0x7fd6bc0e4470 con 0x7fd6c00f5260 2026-02-19T21:04:14.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.611+0000 7fd6c65596c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd69c0b56d0 0x7fd69c0d5b80 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6b0004750 tx=0x7fd6b0005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:14.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.611+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6bc0a73a0 con 0x7fd6c00f5260 2026-02-19T21:04:14.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: pgmap v152: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 176 KiB/s, 0 objects/s recovering 2026-02-19T21:04:14.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: pgmap v153: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 172 KiB/s, 0 objects/s recovering 2026-02-19T21:04:14.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: osdmap e68: 12 total, 11 up, 12 in 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:14.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:14.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:14.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:14.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:14.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:14 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:14.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.704+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd6c01104d0 con 0x7fd6c00f5260 2026-02-19T21:04:14.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.704+0000 7fd6a77fe6c0 1 -- 10.20.193.90:0/58138911 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fd6bc0aa550 con 0x7fd6c00f5260 2026-02-19T21:04:14.706 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:14.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd69c0b56d0 msgr2=0x7fd69c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:14.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd69c0b56d0 0x7fd69c0d5b80 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6b0004750 tx=0x7fd6b0005f10 comp rx=0 tx=0).stop 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 msgr2=0x7fd6c00fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 0x7fd6c00fa530 secure :-1 s=READY pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6bc00c6c0 tx=0x7fd6bc00cb90 comp rx=0 tx=0).stop 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 shutdown_connections 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd69c0b56d0 0x7fd69c0d5b80 unknown :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd6c00f5260 0x7fd6c00fa530 unknown :-1 s=CLOSED pgs=177 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd6c0115410 0x7fd6c0175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 --2- 10.20.193.90:0/58138911 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd6c010f200 0x7fd6c00f4c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 >> 10.20.193.90:0/58138911 conn(0x7fd6c00ecac0 msgr2=0x7fd6c010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 shutdown_connections 2026-02-19T21:04:14.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:14.705+0000 7fd6c87e86c0 1 -- 10.20.193.90:0/58138911 wait complete. 2026-02-19T21:04:14.744 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1771535048,"num_in_osds":12,"osd_in_since":1771535047,"num_remapped_pgs":0} 2026-02-19T21:04:15.267 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:04:14 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:04:14.921+0000 7f1d7a88f6c0 -1 osd.11 0 waiting for initial osdmap 2026-02-19T21:04:15.267 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:04:14 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:04:14.927+0000 7f1d767646c0 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-19T21:04:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:15 trial105 ceph-mon[33883]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:15 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/58138911' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:15 trial105 ceph-mon[33883]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:04:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:15 trial105 ceph-mon[33883]: osdmap e69: 12 total, 11 up, 12 in 2026-02-19T21:04:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:15 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:15 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:15 trial090 ceph-mon[31759]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:15 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/58138911' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:15 trial090 ceph-mon[31759]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:04:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:15 trial090 ceph-mon[31759]: osdmap e69: 12 total, 11 up, 12 in 2026-02-19T21:04:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:15 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:15 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:15.746 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd stat -f json 2026-02-19T21:04:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:15 trial175 ceph-mon[34116]: pgmap v155: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:15 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/58138911' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:15 trial175 ceph-mon[34116]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial175", "root=default"]}]': finished 2026-02-19T21:04:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:15 trial175 ceph-mon[34116]: osdmap e69: 12 total, 11 up, 12 in 2026-02-19T21:04:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:15 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:15 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:15.873 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:15.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- 10.20.193.90:0/1030859266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 msgr2=0x7f8498173b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:15.995 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- 10.20.193.90:0/1030859266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f8498173b10 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=14643286848284511356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f848800aa70 tx=0x7f848802fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- 10.20.193.90:0/1030859266 shutdown_connections 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- 10.20.193.90:0/1030859266 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f8498173b10 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=14643286848284511356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- 10.20.193.90:0/1030859266 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810d950 0x7f8498112990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- 10.20.193.90:0/1030859266 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f849810cf60 0x7f849810d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- 10.20.193.90:0/1030859266 >> 10.20.193.90:0/1030859266 conn(0x7f84980ea840 msgr2=0x7f849810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- 10.20.193.90:0/1030859266 shutdown_connections 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- 10.20.193.90:0/1030859266 wait complete. 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 Processor -- start 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- start start 2026-02-19T21:04:15.996 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810cf60 0x7f849811af60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f849811b4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8498120860 0x7f8498120d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8498121270 con 0x7f8498113170 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84981213e0 con 0x7f8498120860 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f849da146c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f84981215a0 con 0x7f849810cf60 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f849811b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f849811b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41306/0 (socket says 10.20.193.90:41306) 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 -- 10.20.193.90:0/2770325920 learned_addr learned my addr 10.20.193.90:0/2770325920 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 -- 10.20.193.90:0/2770325920 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810cf60 msgr2=0x7f849811af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f8496ffd6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810cf60 0x7f849811af60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810cf60 0x7f849811af60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:15.997 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84977fe6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8498120860 0x7f8498120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 -- 10.20.193.90:0/2770325920 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8498120860 msgr2=0x7f8498120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8498120860 0x7f8498120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 -- 10.20.193.90:0/2770325920 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848800a660 con 0x7f8498113170 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f8496ffd6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810cf60 0x7f849811af60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84977fe6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8498120860 0x7f8498120d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.991+0000 7f84967fc6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f849811b4a0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f848000b6c0 tx=0x7f848000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.992+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8480004240 con 0x7f8498113170 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.992+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8480009030 con 0x7f8498113170 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.992+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8498161a50 con 0x7f8498113170 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.992+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f848000cc70 con 0x7f8498113170 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.992+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8498161ee0 con 0x7f8498113170 2026-02-19T21:04:15.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.992+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849810e230 con 0x7f8498113170 2026-02-19T21:04:15.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.993+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f84800043a0 con 0x7f8498113170 2026-02-19T21:04:15.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.994+0000 7f849ca0e6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f846c0b56d0 0x7f846c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.994+0000 7f8496ffd6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f846c0b56d0 0x7f846c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.994+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7f84800e3740 con 0x7f8498113170 2026-02-19T21:04:16.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.994+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f84800a9fb0 con 0x7f8498113170 2026-02-19T21:04:16.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:15.994+0000 7f8496ffd6c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f846c0b56d0 0x7f846c0d5b80 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f848c004750 tx=0x7f848c005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:16.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.084+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f849811c110 con 0x7f8498113170 2026-02-19T21:04:16.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.084+0000 7f849ca0e6c0 1 -- 10.20.193.90:0/2770325920 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f84800ac020 con 0x7f8498113170 2026-02-19T21:04:16.087 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f846c0b56d0 msgr2=0x7f846c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f846c0b56d0 0x7f846c0d5b80 secure :-1 s=READY pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f848c004750 tx=0x7f848c005f10 comp rx=0 tx=0).stop 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 msgr2=0x7f849811b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f849811b4a0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f848000b6c0 tx=0x7f848000bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 shutdown_connections 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f846c0b56d0 0x7f846c0d5b80 unknown :-1 s=CLOSED pgs=108 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8498120860 0x7f8498120d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8498113170 0x7f849811b4a0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 --2- 10.20.193.90:0/2770325920 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f849810cf60 0x7f849811af60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 >> 10.20.193.90:0/2770325920 conn(0x7f84980ea840 msgr2=0x7f849810ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:16.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 shutdown_connections 2026-02-19T21:04:16.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.086+0000 7f849da146c0 1 -- 10.20.193.90:0/2770325920 wait complete. 2026-02-19T21:04:16.126 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1771535055,"num_in_osds":12,"osd_in_since":1771535047,"num_remapped_pgs":0} 2026-02-19T21:04:16.127 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T21:04:16.251 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:16.364 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: purged_snaps scrub starts 2026-02-19T21:04:16.364 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: purged_snaps scrub ok 2026-02-19T21:04:16.364 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:16.364 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] boot 2026-02-19T21:04:16.365 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: osdmap e70: 12 total, 12 up, 12 in 2026-02-19T21:04:16.365 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:16.365 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:16 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2770325920' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:16.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 -- 10.20.193.90:0/988644647 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff724115410 msgr2=0x7ff724175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/988644647 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff724115410 0x7ff724175db0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=5897648851015970017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff71800aa70 tx=0x7ff71802fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 -- 10.20.193.90:0/988644647 shutdown_connections 2026-02-19T21:04:16.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/988644647 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff724115410 0x7ff724175db0 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=5897648851015970017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/988644647 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff72410fbf0 0x7ff724114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/988644647 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff72410f200 0x7ff72410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 -- 10.20.193.90:0/988644647 >> 10.20.193.90:0/988644647 conn(0x7ff7240eca60 msgr2=0x7ff72410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 -- 10.20.193.90:0/988644647 shutdown_connections 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 -- 10.20.193.90:0/988644647 wait complete. 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 Processor -- start 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.368+0000 7ff72a0706c0 1 -- start start 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 0x7ff72411d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff724115410 0x7ff72411d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff724122b20 0x7ff724122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff724123530 con 0x7ff72410f200 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7241236a0 con 0x7ff724115410 2026-02-19T21:04:16.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff724123860 con 0x7ff724122b20 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 0x7ff72411d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 0x7ff72411d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41330/0 (socket says 10.20.193.90:41330) 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 -- 10.20.193.90:0/975720754 learned_addr learned my addr 10.20.193.90:0/975720754 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff722ffd6c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff724115410 0x7ff72411d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 -- 10.20.193.90:0/975720754 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff724122b20 msgr2=0x7ff724122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff724122b20 0x7ff724122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 -- 10.20.193.90:0/975720754 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff724115410 msgr2=0x7ff72411d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff724115410 0x7ff72411d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 -- 10.20.193.90:0/975720754 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71800a660 con 0x7ff72410f200 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff7237fe6c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 0x7ff72411d220 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7100092e0 tx=0x7ff71000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff710004250 con 0x7ff72410f200 2026-02-19T21:04:16.374 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff7100043b0 con 0x7ff72410f200 2026-02-19T21:04:16.375 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff724163d10 con 0x7ff72410f200 2026-02-19T21:04:16.375 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff71000cd40 con 0x7ff72410f200 2026-02-19T21:04:16.375 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7241641f0 con 0x7ff72410f200 2026-02-19T21:04:16.375 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.369+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7241104d0 con 0x7ff72410f200 2026-02-19T21:04:16.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.371+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7ff7100026b0 con 0x7ff72410f200 2026-02-19T21:04:16.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.372+0000 7ff720ff96c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff6f80b56d0 0x7ff6f80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.372+0000 7ff722ffd6c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff6f80b56d0 0x7ff6f80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.372+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7ff7100e36b0 con 0x7ff72410f200 2026-02-19T21:04:16.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.372+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff7100a9f60 con 0x7ff72410f200 2026-02-19T21:04:16.376 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.372+0000 7ff722ffd6c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff6f80b56d0 0x7ff6f80d5b80 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff724123bb0 tx=0x7ff7140094f0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:16.466 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.465+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff72410fbf0 con 0x7ff72410f200 2026-02-19T21:04:16.467 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.465+0000 7ff720ff96c0 1 -- 10.20.193.90:0/975720754 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18444 (secure 0 0 0) 0x7ff7100abfd0 con 0x7ff72410f200 2026-02-19T21:04:16.467 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:16.467 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":70,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","created":"2026-02-19T21:02:03.870776+0000","modified":"2026-02-19T21:04:15.914313+0000","last_up_change":"2026-02-19T21:04:15.914313+0000","last_in_change":"2026-02-19T21:04:07.215369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T21:03:11.280767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9447a1db-db31-41c0-8732-78156b284c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6803","nonce":300222624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6805","nonce":300222624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6809","nonce":300222624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6807","nonce":300222624}]},"public_addr":"10.20.193.90:6803/300222624","cluster_addr":"10.20.193.90:6805/300222624","heartbeat_back_addr":"10.20.193.90:6809/300222624","heartbeat_front_addr":"10.20.193.90:6807/300222624","state":["exists","up"]},{"osd":1,"uuid":"2ceb6ac4-0471-49bc-b664-7b5053f54250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6801","nonce":515149626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6803","nonce":515149626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6807","nonce":515149626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6805","nonce":515149626}]},"public_addr":"10.20.193.105:6801/515149626","cluster_addr":"10.20.193.105:6803/515149626","heartbeat_back_addr":"10.20.193.105:6807/515149626","heartbeat_front_addr":"10.20.193.105:6805/515149626","state":["exists","up"]},{"osd":2,"uuid":"8ded8050-146f-41a3-a2e7-974118414769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6800","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6801","nonce":2163707084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6802","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6803","nonce":2163707084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6806","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6807","nonce":2163707084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6804","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6805","nonce":2163707084}]},"public_addr":"10.20.193.175:6801/2163707084","cluster_addr":"10.20.193.175:6803/2163707084","heartbeat_back_addr":"10.20.193.175:6807/2163707084","heartbeat_front_addr":"10.20.193.175:6805/2163707084","state":["exists","up"]},{"osd":3,"uuid":"556df040-373e-4795-af5e-297ede87881b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6811","nonce":1075832494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6813","nonce":1075832494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6817","nonce":1075832494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6815","nonce":1075832494}]},"public_addr":"10.20.193.90:6811/1075832494","cluster_addr":"10.20.193.90:6813/1075832494","heartbeat_back_addr":"10.20.193.90:6817/1075832494","heartbeat_front_addr":"10.20.193.90:6815/1075832494","state":["exists","up"]},{"osd":4,"uuid":"a0776450-d439-4c5d-a67d-0ae50bb72319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6809","nonce":891701520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6811","nonce":891701520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6815","nonce":891701520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6813","nonce":891701520}]},"public_addr":"10.20.193.105:6809/891701520","cluster_addr":"10.20.193.105:6811/891701520","heartbeat_back_addr":"10.20.193.105:6815/891701520","heartbeat_front_addr":"10.20.193.105:6813/891701520","state":["exists","up"]},{"osd":5,"uuid":"3450f832-0b90-45d7-a92d-b74809259564","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6808","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6809","nonce":1433153714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6810","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6811","nonce":1433153714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6814","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6815","nonce":1433153714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6812","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6813","nonce":1433153714}]},"public_addr":"10.20.193.175:6809/1433153714","cluster_addr":"10.20.193.175:6811/1433153714","heartbeat_back_addr":"10.20.193.175:6815/1433153714","heartbeat_front_addr":"10.20.193.175:6813/1433153714","state":["exists","up"]},{"osd":6,"uuid":"9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6819","nonce":4121266153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6821","nonce":4121266153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6825","nonce":4121266153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6823","nonce":4121266153}]},"public_addr":"10.20.193.90:6819/4121266153","cluster_addr":"10.20.193.90:6821/4121266153","heartbeat_back_addr":"10.20.193.90:6825/4121266153","heartbeat_front_addr":"10.20.193.90:6823/4121266153","state":["exists","up"]},{"osd":7,"uuid":"6b119453-b94f-441f-8685-a992fe2922ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6817","nonce":3597166844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6818","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6819","nonce":3597166844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6822","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6823","nonce":3597166844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6820","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6821","nonce":3597166844}]},"public_addr":"10.20.193.105:6817/3597166844","cluster_addr":"10.20.193.105:6819/3597166844","heartbeat_back_addr":"10.20.193.105:6823/3597166844","heartbeat_front_addr":"10.20.193.105:6821/3597166844","state":["exists","up"]},{"osd":8,"uuid":"fdfc8889-7eda-48ef-ae9d-5ec9cb798a56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6816","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6817","nonce":711294156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6818","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6819","nonce":711294156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6822","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6823","nonce":711294156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6820","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6821","nonce":711294156}]},"public_addr":"10.20.193.175:6817/711294156","cluster_addr":"10.20.193.175:6819/711294156","heartbeat_back_addr":"10.20.193.175:6823/711294156","heartbeat_front_addr":"10.20.193.175:6821/711294156","state":["exists","up"]},{"osd":9,"uuid":"bfa36c36-03aa-4363-85f7-b4cd9450b612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6827","nonce":72013082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6829","nonce":72013082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6833","nonce":72013082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6831","nonce":72013082}]},"public_addr":"10.20.193.90:6827/72013082","cluster_addr":"10.20.193.90:6829/72013082","heartbeat_back_addr":"10.20.193.90:6833/72013082","heartbeat_front_addr":"10.20.193.90:6831/72013082","state":["exists","up"]},{"osd":10,"uuid":"43e47e1a-7160-446c-8fe3-8a20cc2a4c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6824","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6825","nonce":3923796147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6826","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6827","nonce":3923796147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6830","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6831","nonce":3923796147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6828","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6829","nonce":3923796147}]},"public_addr":"10.20.193.105:6825/3923796147","cluster_addr":"10.20.193.105:6827/3923796147","heartbeat_back_addr":"10.20.193.105:6831/3923796147","heartbeat_front_addr":"10.20.193.105:6829/3923796147","state":["exists","up"]},{"osd":11,"uuid":"b789e6a7-be92-4cae-a3a0-d6eebe9b8629","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6824","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6825","nonce":3785438366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6826","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6827","nonce":3785438366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6830","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6831","nonce":3785438366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6828","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6829","nonce":3785438366}]},"public_addr":"10.20.193.175:6825/3785438366","cluster_addr":"10.20.193.175:6827/3785438366","heartbeat_back_addr":"10.20.193.175:6831/3785438366","heartbeat_front_addr":"10.20.193.175:6829/3785438366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:02:53.889642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:00.781533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:08.187332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:15.317071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:22.497099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:29.848931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:37.269086+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:44.452146+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:51.824076+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:59.325996+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:06.588398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/1864372684":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6800/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1997858222":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/66846304":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6801/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6800/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/2504907435":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6801/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1301435029":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/4201652812":"2026-02-20T21:02:09.876469+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff6f80b56d0 msgr2=0x7ff6f80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff6f80b56d0 0x7ff6f80d5b80 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff724123bb0 tx=0x7ff7140094f0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 msgr2=0x7ff72411d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 0x7ff72411d220 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7100092e0 tx=0x7ff71000bc50 comp rx=0 tx=0).stop 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 shutdown_connections 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff6f80b56d0 0x7ff6f80d5b80 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff724122b20 0x7ff724122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff724115410 0x7ff72411d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 --2- 10.20.193.90:0/975720754 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff72410f200 0x7ff72411d220 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 >> 10.20.193.90:0/975720754 conn(0x7ff7240eca60 msgr2=0x7ff72410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 shutdown_connections 2026-02-19T21:04:16.469 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.467+0000 7ff72a0706c0 1 -- 10.20.193.90:0/975720754 wait complete. 2026-02-19T21:04:16.508 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-19T21:03:11.280767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-19T21:04:16.509 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-19T21:04:16.634 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:16.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: purged_snaps scrub starts 2026-02-19T21:04:16.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: purged_snaps scrub ok 2026-02-19T21:04:16.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:16.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] boot 2026-02-19T21:04:16.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: osdmap e70: 12 total, 12 up, 12 in 2026-02-19T21:04:16.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:16.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:16 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2770325920' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/271611615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a810f200 msgr2=0x7fa3a810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/271611615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a810f200 0x7fa3a810f5d0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=129358928960281655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3980099a0 tx=0x7fa39802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/271611615 shutdown_connections 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/271611615 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa3a8115410 0x7fa3a8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/271611615 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa3a810fbf0 0x7fa3a8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/271611615 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a810f200 0x7fa3a810f5d0 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=129358928960281655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/271611615 >> 10.20.193.90:0/271611615 conn(0x7fa3a80eca60 msgr2=0x7fa3a810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/271611615 shutdown_connections 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/271611615 wait complete. 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 Processor -- start 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- start start 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa3a810f200 0x7fa3a811d300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa3a8115410 0x7fa3a811d840 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 0x7fa3a81230a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a8123610 con 0x7fa3a8122c00 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a8123780 con 0x7fa3a810f200 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.752+0000 7fa3af0d46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a8123940 con 0x7fa3a8115410 2026-02-19T21:04:16.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 0x7fa3a81230a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 0x7fa3a81230a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41362/0 (socket says 10.20.193.90:41362) 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 -- 10.20.193.90:0/2380234373 learned_addr learned my addr 10.20.193.90:0/2380234373 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ace456c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa3a810f200 0x7fa3a811d300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa39ffff6c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa3a8115410 0x7fa3a811d840 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 -- 10.20.193.90:0/2380234373 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa3a8115410 msgr2=0x7fa3a811d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa3a8115410 0x7fa3a811d840 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 -- 10.20.193.90:0/2380234373 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa3a810f200 msgr2=0x7fa3a811d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa3a810f200 0x7fa3a811d300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 -- 10.20.193.90:0/2380234373 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa398009590 con 0x7fa3a8122c00 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3ad6466c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 0x7fa3a81230a0 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a4006ea0 tx=0x7fa3a400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a4003a30 con 0x7fa3a8122c00 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa3a40054f0 con 0x7fa3a8122c00 2026-02-19T21:04:16.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a8163df0 con 0x7fa3a8122c00 2026-02-19T21:04:16.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3a400dcd0 con 0x7fa3a8122c00 2026-02-19T21:04:16.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a81642d0 con 0x7fa3a8122c00 2026-02-19T21:04:16.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.753+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a81104d0 con 0x7fa3a8122c00 2026-02-19T21:04:16.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.755+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fa3a4005030 con 0x7fa3a8122c00 2026-02-19T21:04:16.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.755+0000 7fa39dffb6c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa3840b56d0 0x7fa3840d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:16.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.755+0000 7fa3ace456c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa3840b56d0 0x7fa3840d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:16.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.756+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7119+0+0 (secure 0 0 0) 0x7fa3a40e4750 con 0x7fa3a8122c00 2026-02-19T21:04:16.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.756+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa3a40a7560 con 0x7fa3a8122c00 2026-02-19T21:04:16.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.756+0000 7fa3ace456c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa3840b56d0 0x7fa3840d5b80 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398031fd0 tx=0x7fa3980023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: purged_snaps scrub starts 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: purged_snaps scrub ok 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 299 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: osd.11 [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] boot 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: osdmap e70: 12 total, 12 up, 12 in 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-19T21:04:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:16 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2770325920' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-19T21:04:16.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.849+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3a810fbf0 con 0x7fa3a8122c00 2026-02-19T21:04:16.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.849+0000 7fa39dffb6c0 1 -- 10.20.193.90:0/2380234373 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fa3a400de60 con 0x7fa3a8122c00 2026-02-19T21:04:16.851 INFO:teuthology.orchestra.run.trial090.stdout:pg_num: 1 2026-02-19T21:04:16.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa3840b56d0 msgr2=0x7fa3840d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa3840b56d0 0x7fa3840d5b80 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa398031fd0 tx=0x7fa3980023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 msgr2=0x7fa3a81230a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 0x7fa3a81230a0 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3a4006ea0 tx=0x7fa3a400cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 shutdown_connections 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa3840b56d0 0x7fa3840d5b80 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa3a8122c00 0x7fa3a81230a0 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa3a8115410 0x7fa3a811d840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 --2- 10.20.193.90:0/2380234373 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa3a810f200 0x7fa3a811d300 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 >> 10.20.193.90:0/2380234373 conn(0x7fa3a80eca60 msgr2=0x7fa3a810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 shutdown_connections 2026-02-19T21:04:16.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:16.850+0000 7fa3af0d46c0 1 -- 10.20.193.90:0/2380234373 wait complete. 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.a on trial090 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.d on trial090 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.g on trial090 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.j on trial090 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.b on trial105 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.e on trial105 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.h on trial105 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.k on trial105 2026-02-19T21:04:16.890 INFO:tasks.cephadm:Adding mds.c on trial175 2026-02-19T21:04:16.891 INFO:tasks.cephadm:Adding mds.f on trial175 2026-02-19T21:04:16.891 INFO:tasks.cephadm:Adding mds.i on trial175 2026-02-19T21:04:16.891 INFO:tasks.cephadm:Adding mds.l on trial175 2026-02-19T21:04:16.891 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph orch apply mds all '12;trial090=a;trial090=d;trial090=g;trial090=j;trial105=b;trial105=e;trial105=h;trial105=k;trial175=c;trial175=f;trial175=i;trial175=l' 2026-02-19T21:04:17.019 INFO:teuthology.orchestra.run.trial175.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.c/config 2026-02-19T21:04:17.143 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/1761393551 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410d960 msgr2=0x7f5b841129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.143 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/1761393551 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410d960 0x7f5b841129a0 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=13340608870756529946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b780099a0 tx=0x7f5b7802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:17.143 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/1761393551 shutdown_connections 2026-02-19T21:04:17.143 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/1761393551 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5b84113180 0x7f5b84173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.143 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/1761393551 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410d960 0x7f5b841129a0 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=13340608870756529946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.143 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/1761393551 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b8410cf70 0x7f5b8410d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/1761393551 >> 10.20.193.175:0/1761393551 conn(0x7f5b840ea870 msgr2=0x7f5b8410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/1761393551 shutdown_connections 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/1761393551 wait complete. 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 Processor -- start 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- start start 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 0x7f5b840f3490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b84113180 0x7f5b84173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5b840f3ac0 0x7f5b840f8d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840f41b0 con 0x7f5b84113180 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840f92d0 con 0x7f5b840f3ac0 2026-02-19T21:04:17.144 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.140+0000 7f5b8bb0f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b840f9490 con 0x7f5b8410cf70 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 0x7f5b840f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 0x7f5b840f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.175:51100/0 (socket says 10.20.193.175:51100) 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 -- 10.20.193.175:0/2800211631 learned_addr learned my addr 10.20.193.175:0/2800211631 (peer_addr_for_me v2:10.20.193.175:0/0) 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b8907f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b84113180 0x7f5b84173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b8a0816c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5b840f3ac0 0x7f5b840f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 -- 10.20.193.175:0/2800211631 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5b840f3ac0 msgr2=0x7f5b840f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5b840f3ac0 0x7f5b840f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 -- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b84113180 msgr2=0x7f5b84173a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b84113180 0x7f5b84173a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.145 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 -- 10.20.193.175:0/2800211631 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b78009590 con 0x7f5b8410cf70 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b8907f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b84113180 0x7f5b84173a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b898806c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 0x7f5b840f3490 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b7400b740 tx=0x7f5b7400bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b74004250 con 0x7f5b8410cf70 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b840f9770 con 0x7f5b8410cf70 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5b74009070 con 0x7f5b8410cf70 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b7400cd70 con 0x7f5b8410cf70 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b840f9f00 con 0x7f5b8410cf70 2026-02-19T21:04:17.146 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.141+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b8410e240 con 0x7f5b8410cf70 2026-02-19T21:04:17.147 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.143+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f5b740028c0 con 0x7f5b8410cf70 2026-02-19T21:04:17.147 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.144+0000 7f5b72ffd6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5b600b5650 0x7f5b600d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.148 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.144+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f5b740e3870 con 0x7f5b8410cf70 2026-02-19T21:04:17.148 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.144+0000 7f5b8907f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5b600b5650 0x7f5b600d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.148 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.144+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5b740a6680 con 0x7f5b8410cf70 2026-02-19T21:04:17.148 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.144+0000 7f5b8907f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5b600b5650 0x7f5b600d5b00 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b780092e0 tx=0x7f5b78005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:17.242 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.241+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial090=a;trial090=d;trial090=g;trial090=j;trial105=b;trial105=e;trial105=h;trial105=k;trial175=c;trial175=f;trial175=i;trial175=l", "target": ["mon-mgr", ""]}) -- 0x7f5b840f45e0 con 0x7f5b600b5650 2026-02-19T21:04:17.246 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.246+0000 7f5b72ffd6c0 1 -- 10.20.193.175:0/2800211631 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5b840f45e0 con 0x7f5b600b5650 2026-02-19T21:04:17.247 INFO:teuthology.orchestra.run.trial175.stdout:Scheduled mds.all update... 2026-02-19T21:04:17.248 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5b600b5650 msgr2=0x7f5b600d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.248 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5b600b5650 0x7f5b600d5b00 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b780092e0 tx=0x7f5b78005c00 comp rx=0 tx=0).stop 2026-02-19T21:04:17.248 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 msgr2=0x7f5b840f3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.248 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 0x7f5b840f3490 secure :-1 s=READY pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b7400b740 tx=0x7f5b7400bc10 comp rx=0 tx=0).stop 2026-02-19T21:04:17.248 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 shutdown_connections 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5b600b5650 0x7f5b600d5b00 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5b840f3ac0 0x7f5b840f8d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5b84113180 0x7f5b84173a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 --2- 10.20.193.175:0/2800211631 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5b8410cf70 0x7f5b840f3490 unknown :-1 s=CLOSED pgs=56 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 >> 10.20.193.175:0/2800211631 conn(0x7f5b840ea870 msgr2=0x7f5b841107b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 shutdown_connections 2026-02-19T21:04:17.249 INFO:teuthology.orchestra.run.trial175.stderr:2026-02-19T21:04:17.247+0000 7f5b8bb0f6c0 1 -- 10.20.193.175:0/2800211631 wait complete. 2026-02-19T21:04:17.287 DEBUG:teuthology.orchestra.run.trial090:mds.a> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.a.service 2026-02-19T21:04:17.290 DEBUG:teuthology.orchestra.run.trial090:mds.d> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.d.service 2026-02-19T21:04:17.334 DEBUG:teuthology.orchestra.run.trial090:mds.g> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.g.service 2026-02-19T21:04:17.376 DEBUG:teuthology.orchestra.run.trial090:mds.j> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.j.service 2026-02-19T21:04:17.420 DEBUG:teuthology.orchestra.run.trial105:mds.b> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.b.service 2026-02-19T21:04:17.423 DEBUG:teuthology.orchestra.run.trial105:mds.e> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.e.service 2026-02-19T21:04:17.466 DEBUG:teuthology.orchestra.run.trial105:mds.h> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.h.service 2026-02-19T21:04:17.503 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/975720754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:17.503 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2380234373' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-19T21:04:17.503 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: osdmap e71: 12 total, 12 up, 12 in 2026-02-19T21:04:17.503 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:17.504 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:17 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:17.509 DEBUG:teuthology.orchestra.run.trial105:mds.k> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.k.service 2026-02-19T21:04:17.553 DEBUG:teuthology.orchestra.run.trial175:mds.c> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.c.service 2026-02-19T21:04:17.555 DEBUG:teuthology.orchestra.run.trial175:mds.f> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.f.service 2026-02-19T21:04:17.573 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/975720754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:17.573 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2380234373' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: osdmap e71: 12 total, 12 up, 12 in 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:17.574 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:17 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:17.599 DEBUG:teuthology.orchestra.run.trial175:mds.i> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.i.service 2026-02-19T21:04:17.643 DEBUG:teuthology.orchestra.run.trial175:mds.l> sudo journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.l.service 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/975720754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2380234373' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: osdmap e71: 12 total, 12 up, 12 in 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:17.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:17.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:17.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:17 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:17.687 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-19T21:04:17.687 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs dump --format=json 2026-02-19T21:04:17.810 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:17.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 -- 10.20.193.90:0/280689617 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410fbf0 msgr2=0x7fafc4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/280689617 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410fbf0 0x7fafc4114c30 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=4669166466531077519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafb80099a0 tx=0x7fafb802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 -- 10.20.193.90:0/280689617 shutdown_connections 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/280689617 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc4115410 0x7fafc4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/280689617 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410fbf0 0x7fafc4114c30 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=4669166466531077519 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/280689617 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fafc410f200 0x7fafc410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 -- 10.20.193.90:0/280689617 >> 10.20.193.90:0/280689617 conn(0x7fafc40ecac0 msgr2=0x7fafc410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 -- 10.20.193.90:0/280689617 shutdown_connections 2026-02-19T21:04:17.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 -- 10.20.193.90:0/280689617 wait complete. 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.923+0000 7fafcc1546c0 1 Processor -- start 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 -- start start 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 0x7fafc40f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fafc4115410 0x7fafc4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc40f5260 0x7fafc40fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafc40f5950 con 0x7fafc410f200 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafc40faa70 con 0x7fafc4115410 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fafc40fac30 con 0x7fafc40f5260 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 0x7fafc40f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 0x7fafc40f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41382/0 (socket says 10.20.193.90:41382) 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 -- 10.20.193.90:0/4249601351 learned_addr learned my addr 10.20.193.90:0/4249601351 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:17.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc96c46c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fafc4115410 0x7fafc4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafca6c66c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc40f5260 0x7fafc40fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 -- 10.20.193.90:0/4249601351 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc40f5260 msgr2=0x7fafc40fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc40f5260 0x7fafc40fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 -- 10.20.193.90:0/4249601351 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fafc4115410 msgr2=0x7fafc4175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fafc4115410 0x7fafc4175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 -- 10.20.193.90:0/4249601351 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb8009590 con 0x7fafc410f200 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafca6c66c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc40f5260 0x7fafc40fa530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafc9ec56c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 0x7fafc40f4c30 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafb400b6c0 tx=0x7fafb400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafb40044a0 con 0x7fafc410f200 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fafb400be50 con 0x7fafc410f200 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc40faf10 con 0x7fafc410f200 2026-02-19T21:04:17.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fafb400cd00 con 0x7fafc410f200 2026-02-19T21:04:17.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.924+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc40fb6a0 con 0x7fafc410f200 2026-02-19T21:04:17.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.925+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc41104d0 con 0x7fafc410f200 2026-02-19T21:04:17.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.926+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fafb40026b0 con 0x7fafc410f200 2026-02-19T21:04:17.932 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.926+0000 7fafb2ffd6c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fafa00b5650 0x7fafa00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:17.932 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.926+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fafb40e35d0 con 0x7fafc410f200 2026-02-19T21:04:17.932 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.926+0000 7fafc96c46c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fafa00b5650 0x7fafa00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:17.932 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.927+0000 7fafc96c46c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fafa00b5650 0x7fafa00d5b00 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafb8005b40 tx=0x7fafb80023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:17.932 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:17.927+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fafb40a6470 con 0x7fafc410f200 2026-02-19T21:04:18.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.040+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafc40f5d80 con 0x7fafc410f200 2026-02-19T21:04:18.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.040+0000 7fafb2ffd6c0 1 -- 10.20.193.90:0/4249601351 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fafb40a9590 con 0x7fafc410f200 2026-02-19T21:04:18.043 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:18.043 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":1,"btime":"2026-02-19T21:02:03:870646+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:dumped fsmap epoch 1 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fafa00b5650 msgr2=0x7fafa00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fafa00b5650 0x7fafa00d5b00 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafb8005b40 tx=0x7fafb80023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 msgr2=0x7fafc40f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 0x7fafc40f4c30 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafb400b6c0 tx=0x7fafb400bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 shutdown_connections 2026-02-19T21:04:18.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fafa00b5650 0x7fafa00d5b00 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:18.045 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fafc40f5260 0x7fafc40fa530 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:18.045 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fafc4115410 0x7fafc4175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:18.045 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 --2- 10.20.193.90:0/4249601351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fafc410f200 0x7fafc40f4c30 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:18.045 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 >> 10.20.193.90:0/4249601351 conn(0x7fafc40ecac0 msgr2=0x7fafc410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:18.045 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 shutdown_connections 2026-02-19T21:04:18.045 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:18.041+0000 7fafcc1546c0 1 -- 10.20.193.90:0/4249601351 wait complete. 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial090=a;trial090=d;trial090=g;trial090=j;trial105=b;trial105=e;trial105=h;trial105=k;trial175=c;trial175=f;trial175=i;trial175=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:18.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:18 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4249601351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial090=a;trial090=d;trial090=g;trial090=j;trial105=b;trial105=e;trial105=h;trial105=k;trial175=c;trial175=f;trial175=i;trial175=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:04:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:18.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:18 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4249601351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:18.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial090=a;trial090=d;trial090=g;trial090=j;trial105=b;trial105=e;trial105=h;trial105=k;trial175=c;trial175=f;trial175=i;trial175=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:18.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:18 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4249601351' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:18.768 INFO:journalctl@ceph.mds.l.trial175.stdout:Feb 19 21:04:18 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-l[63774]: starting mds.l at 2026-02-19T21:04:19.302 INFO:journalctl@ceph.mds.k.trial105.stdout:Feb 19 21:04:19 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-k[62469]: starting mds.k at 2026-02-19T21:04:19.603 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.175:6832/3709156295,v1:10.20.193.175:6833/3709156295] up:boot 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: fsmap 1 up:standby 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.604 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:19.605 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:19.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:19.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:19.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.175:6832/3709156295,v1:10.20.193.175:6833/3709156295] up:boot 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: fsmap 1 up:standby 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:19.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:19.647 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:19 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.175:6832/3709156295,v1:10.20.193.175:6833/3709156295] up:boot 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: fsmap 1 up:standby 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:19.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:19 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:19.887 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.j.service - Ceph mds.j for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:04:20.082 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs dump --format=json 2026-02-19T21:04:20.148 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 podman[69609]: 2026-02-19 21:04:19.886050266 +0000 UTC m=+0.014637471 container create 977923f547231cee51235bdd6562f1c1109d82930dbf7fe4effe0385b7e701e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-j, name=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, version=10, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, license=BSD-3-Clause, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 podman[69609]: 2026-02-19 21:04:19.910278476 +0000 UTC m=+0.038865681 container init 977923f547231cee51235bdd6562f1c1109d82930dbf7fe4effe0385b7e701e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-j, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, io.buildah.version=1.41.3, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, summary=Rocky Linux Base image, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default) 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 podman[69609]: 2026-02-19 21:04:19.912050636 +0000 UTC m=+0.040637841 container start 977923f547231cee51235bdd6562f1c1109d82930dbf7fe4effe0385b7e701e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-j, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, summary=Rocky Linux Base image, version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 bash[69609]: 977923f547231cee51235bdd6562f1c1109d82930dbf7fe4effe0385b7e701e1 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 podman[69609]: 2026-02-19 21:04:19.879326533 +0000 UTC m=+0.007913748 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.j.service - Ceph mds.j for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 ceph-mds[69635]: -- 10.20.193.90:0/3217511240 <== mon.0 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5565b6a95860 con 0x5565b6b2d400 2026-02-19T21:04:20.149 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:04:19 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-j[69631]: starting mds.j at 2026-02-19T21:04:20.208 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:20.474 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/1070876408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe29810cf60 msgr2=0x7fe29810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:20.474 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/1070876408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe29810cf60 0x7fe29810d330 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=13292767061821698384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2880099a0 tx=0x7fe28802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:20.474 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/1070876408 shutdown_connections 2026-02-19T21:04:20.474 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/1070876408 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe298113170 0x7fe298173b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.474 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/1070876408 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe29810d950 0x7fe298112990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.475 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/1070876408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe29810cf60 0x7fe29810d330 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=13292767061821698384 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.475 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/1070876408 >> 10.20.193.90:0/1070876408 conn(0x7fe2980ea840 msgr2=0x7fe29810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:20.475 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/1070876408 shutdown_connections 2026-02-19T21:04:20.475 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/1070876408 wait complete. 2026-02-19T21:04:20.475 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 Processor -- start 2026-02-19T21:04:20.475 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- start start 2026-02-19T21:04:20.476 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe29810cf60 0x7fe2980f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:20.476 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 0x7fe298173a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:20.476 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe2980f5270 0x7fe2980fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:20.476 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe2980f5960 con 0x7fe298113170 2026-02-19T21:04:20.476 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2980faa80 con 0x7fe29810cf60 2026-02-19T21:04:20.476 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.470+0000 7fe29ffc06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe2980fac40 con 0x7fe2980f5270 2026-02-19T21:04:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 0x7fe298173a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 0x7fe298173a10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41426/0 (socket says 10.20.193.90:41426) 2026-02-19T21:04:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 -- 10.20.193.90:0/4265420756 learned_addr learned my addr 10.20.193.90:0/4265420756 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29e5366c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe2980f5270 0x7fe2980fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29dd356c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe29810cf60 0x7fe2980f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 -- 10.20.193.90:0/4265420756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe2980f5270 msgr2=0x7fe2980fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe2980f5270 0x7fe2980fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 -- 10.20.193.90:0/4265420756 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe29810cf60 msgr2=0x7fe2980f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe29810cf60 0x7fe2980f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 -- 10.20.193.90:0/4265420756 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe288009590 con 0x7fe298113170 2026-02-19T21:04:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29dd356c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe29810cf60 0x7fe2980f4c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29d5346c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 0x7fe298173a10 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe28c00b6c0 tx=0x7fe28c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe28c004250 con 0x7fe298113170 2026-02-19T21:04:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe28c009070 con 0x7fe298113170 2026-02-19T21:04:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2980faf20 con 0x7fe298113170 2026-02-19T21:04:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe28c00ccb0 con 0x7fe298113170 2026-02-19T21:04:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2980fb6b0 con 0x7fe298113170 2026-02-19T21:04:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.471+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2980fb400 con 0x7fe298113170 2026-02-19T21:04:20.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.473+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fe28c0028c0 con 0x7fe298113170 2026-02-19T21:04:20.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.473+0000 7fe286ffd6c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe2740b56d0 0x7fe2740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:20.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.474+0000 7fe29dd356c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe2740b56d0 0x7fe2740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:20.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.474+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fe28c0e3690 con 0x7fe298113170 2026-02-19T21:04:20.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.474+0000 7fe29dd356c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe2740b56d0 0x7fe2740d5b80 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe288009970 tx=0x7fe2880023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:20.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.474+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe28c0a64a0 con 0x7fe298113170 2026-02-19T21:04:20.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.590+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe29810e230 con 0x7fe298113170 2026-02-19T21:04:20.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.591+0000 7fe286ffd6c0 1 -- 10.20.193.90:0/4265420756 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fe28c0a9650 con 0x7fe298113170 2026-02-19T21:04:20.592 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:20.592 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":4,"btime":"2026-02-19T21:04:20:481180+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/2408399270","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":2408399270},{"type":"v1","addr":"10.20.193.90:6835","nonce":2408399270}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6833/3709156295","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6832","nonce":3709156295},{"type":"v1","addr":"10.20.193.175:6833","nonce":3709156295}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6833/4254586612","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6832","nonce":4254586612},{"type":"v1","addr":"10.20.193.105:6833","nonce":4254586612}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-19T21:04:20.593 INFO:teuthology.orchestra.run.trial090.stderr:dumped fsmap epoch 4 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.592+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe2740b56d0 msgr2=0x7fe2740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.592+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe2740b56d0 0x7fe2740d5b80 secure :-1 s=READY pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe288009970 tx=0x7fe2880023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.592+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 msgr2=0x7fe298173a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.592+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 0x7fe298173a10 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe28c00b6c0 tx=0x7fe28c00bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 shutdown_connections 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe2740b56d0 0x7fe2740d5b80 unknown :-1 s=CLOSED pgs=115 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe2980f5270 0x7fe2980fa540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe298113170 0x7fe298173a10 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 --2- 10.20.193.90:0/4265420756 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe29810cf60 0x7fe2980f4c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 >> 10.20.193.90:0/4265420756 conn(0x7fe2980ea840 msgr2=0x7fe29810b460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 shutdown_connections 2026-02-19T21:04:20.594 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:20.593+0000 7fe29ffc06c0 1 -- 10.20.193.90:0/4265420756 wait complete. 2026-02-19T21:04:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.105:6832/4254586612,v1:10.20.193.105:6833/4254586612] up:boot 2026-02-19T21:04:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: fsmap 2 up:standby 2026-02-19T21:04:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-19T21:04:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:20.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:20.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:20.658 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:20.658 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.d.service - Ceph mds.d for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:04:20.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.105:6832/4254586612,v1:10.20.193.105:6833/4254586612] up:boot 2026-02-19T21:04:20.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: fsmap 2 up:standby 2026-02-19T21:04:20.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:20.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:20 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:20.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.105:6832/4254586612,v1:10.20.193.105:6833/4254586612] up:boot 2026-02-19T21:04:20.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: fsmap 2 up:standby 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:20.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:20 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 podman[70056]: 2026-02-19 21:04:20.669634571 +0000 UTC m=+0.016212727 container create e89cb19f6c1db4c9d7dee830222272d6c517a2321bbb65fa2fa5cb94511652aa (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-d, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, name=rockylinux, version=10, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, summary=Rocky Linux Base image) 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 podman[70056]: 2026-02-19 21:04:20.704272536 +0000 UTC m=+0.050850702 container init e89cb19f6c1db4c9d7dee830222272d6c517a2321bbb65fa2fa5cb94511652aa (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-d, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.41.3, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 podman[70056]: 2026-02-19 21:04:20.706362183 +0000 UTC m=+0.052940339 container start e89cb19f6c1db4c9d7dee830222272d6c517a2321bbb65fa2fa5cb94511652aa (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-d, io.buildah.version=1.41.3, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, name=rockylinux, summary=Rocky Linux Base image, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686) 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 bash[70056]: e89cb19f6c1db4c9d7dee830222272d6c517a2321bbb65fa2fa5cb94511652aa 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 podman[70056]: 2026-02-19 21:04:20.663441469 +0000 UTC m=+0.010019645 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.d.service - Ceph mds.d for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 ceph-mds[70080]: -- 10.20.193.90:0/3634358414 <== mon.0 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c21983860 con 0x557c21a1b800 2026-02-19T21:04:21.157 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:04:20 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-d[70075]: starting mds.d at 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.90:6834/2408399270,v1:10.20.193.90:6835/2408399270] up:boot 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: fsmap 3 up:standby 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4265420756' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:21.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:21.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:21 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:21.646 INFO:journalctl@ceph.mds.e.trial105.stdout:Feb 19 21:04:21 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-e[62817]: starting mds.e at 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.90:6834/2408399270,v1:10.20.193.90:6835/2408399270] up:boot 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: fsmap 3 up:standby 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4265420756' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:21.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:21.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:21 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.90:6834/2408399270,v1:10.20.193.90:6835/2408399270] up:boot 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: fsmap 3 up:standby 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4265420756' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:21.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:21.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:21.908 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:21 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:22.034 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.f.service - Ceph mds.f for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 podman[64095]: 2026-02-19 21:04:22.146519547 +0000 UTC m=+0.015822036 container create c518644596ff1c4285bd7629b9dc1e4c0ea0e073c4945255fa418f7c9401a3a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-f, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, summary=Rocky Linux Base image, name=rockylinux, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10) 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 podman[64095]: 2026-02-19 21:04:22.179050539 +0000 UTC m=+0.048353018 container init c518644596ff1c4285bd7629b9dc1e4c0ea0e073c4945255fa418f7c9401a3a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, ceph=True, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3) 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 podman[64095]: 2026-02-19 21:04:22.180495259 +0000 UTC m=+0.049797738 container start c518644596ff1c4285bd7629b9dc1e4c0ea0e073c4945255fa418f7c9401a3a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, ceph=True, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 bash[64095]: c518644596ff1c4285bd7629b9dc1e4c0ea0e073c4945255fa418f7c9401a3a1 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 podman[64095]: 2026-02-19 21:04:22.139743282 +0000 UTC m=+0.009045781 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.f.service - Ceph mds.f for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:04:22.412 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mds[64121]: -- 10.20.193.175:0/202207258 <== mon.1 v2:10.20.193.175:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555fe4e23860 con 0x555fe4ebb800 2026-02-19T21:04:22.413 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:04:22 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-f[64117]: starting mds.f at 2026-02-19T21:04:22.636 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs dump --format=json 2026-02-19T21:04:22.680 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.90:6836/248858987,v1:10.20.193.90:6837/248858987] up:boot 2026-02-19T21:04:22.680 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.105:6834/3619938278,v1:10.20.193.105:6835/3619938278] up:boot 2026-02-19T21:04:22.680 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: fsmap 5 up:standby 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:22.681 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:22.760 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.90:6836/248858987,v1:10.20.193.90:6837/248858987] up:boot 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.105:6834/3619938278,v1:10.20.193.105:6835/3619938278] up:boot 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: fsmap 5 up:standby 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.780 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:22.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:22.781 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:22 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- 10.20.193.90:0/630388551 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 msgr2=0x7f873c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/630388551 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c10f5d0 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=16539202366250581872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f872c0099a0 tx=0x7f872c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- 10.20.193.90:0/630388551 shutdown_connections 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/630388551 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f873c115410 0x7f873c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/630388551 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f873c10fbf0 0x7f873c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/630388551 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c10f5d0 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=16539202366250581872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- 10.20.193.90:0/630388551 >> 10.20.193.90:0/630388551 conn(0x7f873c0ecac0 msgr2=0x7f873c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- 10.20.193.90:0/630388551 shutdown_connections 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- 10.20.193.90:0/630388551 wait complete. 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 Processor -- start 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- start start 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c11d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f873c115410 0x7f873c11d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f873c122c20 0x7f873c1230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f873c123630 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f873c1237a0 con 0x7f873c115410 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.870+0000 7f8742ee76c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f873c123960 con 0x7f873c122c20 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c11d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c11d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41456/0 (socket says 10.20.193.90:41456) 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 -- 10.20.193.90:0/1830376127 learned_addr learned my addr 10.20.193.90:0/1830376127 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 -- 10.20.193.90:0/1830376127 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f873c122c20 msgr2=0x7f873c1230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f873c122c20 0x7f873c1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 -- 10.20.193.90:0/1830376127 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f873c115410 msgr2=0x7f873c11d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f873c115410 0x7f873c11d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 -- 10.20.193.90:0/1830376127 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872c009590 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8740c586c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c11d320 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f872c02f230 tx=0x7f872c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f872c002ba0 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f872c002d00 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873c163db0 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f872c0372f0 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873c164230 con 0x7f873c10f200 2026-02-19T21:04:22.873 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.871+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f873c1104d0 con 0x7f873c10f200 2026-02-19T21:04:22.874 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.873+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f872c0078d0 con 0x7f873c10f200 2026-02-19T21:04:22.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.874+0000 7f8731ffb6c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f87180b56d0 0x7f87180d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:22.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.874+0000 7f8733fff6c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f87180b56d0 0x7f87180d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:22.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.874+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f872c107920 con 0x7f873c10f200 2026-02-19T21:04:22.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.874+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f872c0cd700 con 0x7f873c10f200 2026-02-19T21:04:22.875 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.874+0000 7f8733fff6c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f87180b56d0 0x7f87180d5b80 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f873c123cb0 tx=0x7f8724009410 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.90:6836/248858987,v1:10.20.193.90:6837/248858987] up:boot 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.105:6834/3619938278,v1:10.20.193.105:6835/3619938278] up:boot 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: fsmap 5 up:standby 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:22.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:22 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:22.989 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.987+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f873c10fbf0 con 0x7f873c10f200 2026-02-19T21:04:22.989 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.987+0000 7f8731ffb6c0 1 -- 10.20.193.90:0/1830376127 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5569 (secure 0 0 0) 0x7f872c0cd8e0 con 0x7f873c10f200 2026-02-19T21:04:22.989 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:22.990 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":6,"btime":"2026-02-19T21:04:22:487059+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/2408399270","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":2408399270},{"type":"v1","addr":"10.20.193.90:6835","nonce":2408399270}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6837/248858987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":248858987},{"type":"v1","addr":"10.20.193.90:6837","nonce":248858987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6833/3709156295","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6832","nonce":3709156295},{"type":"v1","addr":"10.20.193.175:6833","nonce":3709156295}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6833/4254586612","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6832","nonce":4254586612},{"type":"v1","addr":"10.20.193.105:6833","nonce":4254586612}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6835/1761051629","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6834","nonce":1761051629},{"type":"v1","addr":"10.20.193.175:6835","nonce":1761051629}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6835/3619938278","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6834","nonce":3619938278},{"type":"v1","addr":"10.20.193.105:6835","nonce":3619938278}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2026-02-19T21:04:22.990 INFO:teuthology.orchestra.run.trial090.stderr:dumped fsmap epoch 6 2026-02-19T21:04:22.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f87180b56d0 msgr2=0x7f87180d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:22.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f87180b56d0 0x7f87180d5b80 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f873c123cb0 tx=0x7f8724009410 comp rx=0 tx=0).stop 2026-02-19T21:04:22.990 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 msgr2=0x7f873c11d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c11d320 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f872c02f230 tx=0x7f872c02fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 shutdown_connections 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f87180b56d0 0x7f87180d5b80 unknown :-1 s=CLOSED pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f873c122c20 0x7f873c1230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f873c115410 0x7f873c11d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 --2- 10.20.193.90:0/1830376127 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f873c10f200 0x7f873c11d320 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 >> 10.20.193.90:0/1830376127 conn(0x7f873c0ecac0 msgr2=0x7f873c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 shutdown_connections 2026-02-19T21:04:22.991 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:22.989+0000 7f8742ee76c0 1 -- 10.20.193.90:0/1830376127 wait complete. 2026-02-19T21:04:23.267 INFO:journalctl@ceph.mds.c.trial175.stdout:Feb 19 21:04:22 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-c[64465]: starting mds.c at 2026-02-19T21:04:23.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.175:6834/1761051629,v1:10.20.193.175:6835/1761051629] up:boot 2026-02-19T21:04:23.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: fsmap 6 up:standby 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:23.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:23 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1830376127' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.175:6834/1761051629,v1:10.20.193.175:6835/1761051629] up:boot 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: fsmap 6 up:standby 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:23.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:23.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:23.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:23 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1830376127' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:23.896 INFO:journalctl@ceph.mds.h.trial105.stdout:Feb 19 21:04:23 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-h[63164]: starting mds.h at 2026-02-19T21:04:23.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.175:6834/1761051629,v1:10.20.193.175:6835/1761051629] up:boot 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: fsmap 6 up:standby 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:23.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:23 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1830376127' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.175:6836/649777128,v1:10.20.193.175:6837/649777128] up:boot 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: fsmap 7 up:standby 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:24.756 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:24 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.175:6836/649777128,v1:10.20.193.175:6837/649777128] up:boot 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: fsmap 7 up:standby 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:24.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:24.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:24 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:24.767 INFO:journalctl@ceph.mds.i.trial175.stdout:Feb 19 21:04:24 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-i[64809]: starting mds.i at 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.175:6836/649777128,v1:10.20.193.175:6837/649777128] up:boot 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: fsmap 7 up:standby 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:24.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:24 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:25.034 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs dump --format=json 2026-02-19T21:04:25.119 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 systemd[1]: Starting ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.g.service - Ceph mds.g for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:04:25.160 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 -- 10.20.193.90:0/2235666364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c057c10 msgr2=0x7f730c057fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/2235666364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c057c10 0x7f730c057fe0 secure :-1 s=READY pgs=196 gs=2 cs=0 l=1 c_cookie=18152259262879787209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72fc009970 tx=0x7f72fc02ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 -- 10.20.193.90:0/2235666364 shutdown_connections 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/2235666364 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f730c15e080 0x7f730c17e460 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/2235666364 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f730c058520 0x7f730c15db40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/2235666364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c057c10 0x7f730c057fe0 unknown :-1 s=CLOSED pgs=196 gs=2 cs=0 l=1 c_cookie=18152259262879787209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 -- 10.20.193.90:0/2235666364 >> 10.20.193.90:0/2235666364 conn(0x7f730c05e020 msgr2=0x7f730c05e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 -- 10.20.193.90:0/2235666364 shutdown_connections 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 -- 10.20.193.90:0/2235666364 wait complete. 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 Processor -- start 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.289+0000 7f7312ea46c0 1 -- start start 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f730c057c10 0x7f730c0ff240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 0x7f730c0ff780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f730c15e080 0x7f730c104b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f730c105190 con 0x7f730c058520 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f730c105300 con 0x7f730c15e080 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1054c0 con 0x7f730c057c10 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 0x7f730c0ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 0x7f730c0ff780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33898/0 (socket says 10.20.193.90:33898) 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 -- 10.20.193.90:0/702196463 learned_addr learned my addr 10.20.193.90:0/702196463 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:25.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f731141a6c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f730c15e080 0x7f730c104b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7310c196c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f730c057c10 0x7f730c0ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 -- 10.20.193.90:0/702196463 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f730c057c10 msgr2=0x7f730c0ff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f730c057c10 0x7f730c0ff240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 -- 10.20.193.90:0/702196463 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f730c15e080 msgr2=0x7f730c104b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f730c15e080 0x7f730c104b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 -- 10.20.193.90:0/702196463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72fc009590 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7303fff6c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 0x7f730c0ff780 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72f400b6c0 tx=0x7f72f400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72f40044a0 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f72f4009030 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1057a0 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72f400cc10 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c159cb0 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.290+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c1059c0 con 0x7f730c058520 2026-02-19T21:04:25.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.292+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f72f40026b0 con 0x7f730c058520 2026-02-19T21:04:25.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.292+0000 7f7301ffb6c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f72e80b5650 0x7f72e80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:25.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.293+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f72f40e3650 con 0x7f730c058520 2026-02-19T21:04:25.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.293+0000 7f7310c196c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f72e80b5650 0x7f72e80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:25.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.293+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f72f40a6460 con 0x7f730c058520 2026-02-19T21:04:25.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.293+0000 7f7310c196c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f72e80b5650 0x7f72e80d5b00 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72fc0023e0 tx=0x7f72fc005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 podman[70530]: 2026-02-19 21:04:25.118129178 +0000 UTC m=+0.016852148 container create 3f4988668b7e37d62523f9fbfa4ddc4cde6ea42faab566d672af6f0ccdcfd6d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-g, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, license=BSD-3-Clause, summary=Rocky Linux Base image) 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 podman[70530]: 2026-02-19 21:04:25.151448077 +0000 UTC m=+0.050171047 container init 3f4988668b7e37d62523f9fbfa4ddc4cde6ea42faab566d672af6f0ccdcfd6d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-g, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.version=10, ceph=True) 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 podman[70530]: 2026-02-19 21:04:25.15314369 +0000 UTC m=+0.051866660 container start 3f4988668b7e37d62523f9fbfa4ddc4cde6ea42faab566d672af6f0ccdcfd6d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-g, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, name=rockylinux) 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 bash[70530]: 3f4988668b7e37d62523f9fbfa4ddc4cde6ea42faab566d672af6f0ccdcfd6d6 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 podman[70530]: 2026-02-19 21:04:25.110913062 +0000 UTC m=+0.009636042 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 systemd[1]: Started ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.g.service - Ceph mds.g for 34db945f-0dd6-11f1-890f-d404e6e7d460. 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mds[70562]: -- 10.20.193.90:0/2130570975 <== mon.0 v2:10.20.193.90:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562754edb860 con 0x562754f73800 2026-02-19T21:04:25.389 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:04:25 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-g[70550]: starting mds.g at 2026-02-19T21:04:25.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.410+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f730c100390 con 0x7f730c058520 2026-02-19T21:04:25.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.410+0000 7f7301ffb6c0 1 -- 10.20.193.90:0/702196463 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+8050 (secure 0 0 0) 0x7f72f40a9610 con 0x7f730c058520 2026-02-19T21:04:25.412 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:25.412 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":8,"btime":"2026-02-19T21:04:24:494707+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/2408399270","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":2408399270},{"type":"v1","addr":"10.20.193.90:6835","nonce":2408399270}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6837/248858987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":248858987},{"type":"v1","addr":"10.20.193.90:6837","nonce":248858987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6833/3709156295","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6832","nonce":3709156295},{"type":"v1","addr":"10.20.193.175:6833","nonce":3709156295}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6833/4254586612","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6832","nonce":4254586612},{"type":"v1","addr":"10.20.193.105:6833","nonce":4254586612}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6835/1761051629","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6834","nonce":1761051629},{"type":"v1","addr":"10.20.193.175:6835","nonce":1761051629}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6835/3619938278","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6834","nonce":3619938278},{"type":"v1","addr":"10.20.193.105:6835","nonce":3619938278}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6837/649777128","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6836","nonce":649777128},{"type":"v1","addr":"10.20.193.175:6837","nonce":649777128}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6839/1534233526","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6838","nonce":1534233526},{"type":"v1","addr":"10.20.193.175:6839","nonce":1534233526}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6837/2484410627","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6836","nonce":2484410627},{"type":"v1","addr":"10.20.193.105:6837","nonce":2484410627}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-19T21:04:25.412 INFO:teuthology.orchestra.run.trial090.stderr:dumped fsmap epoch 8 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f72e80b5650 msgr2=0x7f72e80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f72e80b5650 0x7f72e80d5b00 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72fc0023e0 tx=0x7f72fc005c60 comp rx=0 tx=0).stop 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 msgr2=0x7f730c0ff780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 0x7f730c0ff780 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72f400b6c0 tx=0x7f72f400bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 shutdown_connections 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f72e80b5650 0x7f72e80d5b00 unknown :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f730c15e080 0x7f730c104b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f730c058520 0x7f730c0ff780 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 --2- 10.20.193.90:0/702196463 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f730c057c10 0x7f730c0ff240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:25.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 >> 10.20.193.90:0/702196463 conn(0x7f730c05e020 msgr2=0x7f730c0fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:25.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 shutdown_connections 2026-02-19T21:04:25.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:25.412+0000 7f7312ea46c0 1 -- 10.20.193.90:0/702196463 wait complete. 2026-02-19T21:04:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.105:6836/2484410627,v1:10.20.193.105:6837/2484410627] up:boot 2026-02-19T21:04:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.175:6838/1534233526,v1:10.20.193.175:6839/1534233526] up:boot 2026-02-19T21:04:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: fsmap 9 up:standby 2026-02-19T21:04:25.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/702196463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:25.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.105:6836/2484410627,v1:10.20.193.105:6837/2484410627] up:boot 2026-02-19T21:04:25.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.175:6838/1534233526,v1:10.20.193.175:6839/1534233526] up:boot 2026-02-19T21:04:25.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: fsmap 9 up:standby 2026-02-19T21:04:25.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:25.767 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:25 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/702196463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:25.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.105:6836/2484410627,v1:10.20.193.105:6837/2484410627] up:boot 2026-02-19T21:04:25.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.175:6838/1534233526,v1:10.20.193.175:6839/1534233526] up:boot 2026-02-19T21:04:25.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: fsmap 9 up:standby 2026-02-19T21:04:25.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-19T21:04:25.895 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:25.896 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:25 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/702196463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:26.157 INFO:journalctl@ceph.mds.a.trial090.stdout:Feb 19 21:04:25 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-a[70970]: starting mds.a at 2026-02-19T21:04:26.726 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-b[63509]: starting mds.b at 2026-02-19T21:04:26.727 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.90:6838/3725935308,v1:10.20.193.90:6839/3725935308] up:boot 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: fsmap 10 up:standby 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.728 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.984 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.984 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.984 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:26 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.90:6838/3725935308,v1:10.20.193.90:6839/3725935308] up:boot 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: fsmap 10 up:standby 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:26.985 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:26.986 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:26.986 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.986 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.986 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.986 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.986 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:26 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.90:6838/3725935308,v1:10.20.193.90:6839/3725935308] up:boot 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: fsmap 10 up:standby 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:26.989 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:26 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.479 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs dump --format=json 2026-02-19T21:04:27.607 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/1852425746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf8115410 msgr2=0x7f1bf8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/1852425746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf8115410 0x7f1bf8175db0 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=12237430019541193228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1bec00aa70 tx=0x7f1bec02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/1852425746 shutdown_connections 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/1852425746 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf8115410 0x7f1bf8175db0 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=12237430019541193228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/1852425746 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf810fbf0 0x7f1bf8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/1852425746 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1bf810f200 0x7f1bf810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/1852425746 >> 10.20.193.90:0/1852425746 conn(0x7f1bf80eca60 msgr2=0x7f1bf810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/1852425746 shutdown_connections 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/1852425746 wait complete. 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 Processor -- start 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- start start 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 0x7f1bf811d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1bf8115410 0x7f1bf811d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf8122b20 0x7f1bf8122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8123530 con 0x7f1bf810f200 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf81236a0 con 0x7f1bf8115410 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bfdb086c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf8123860 con 0x7f1bf8122b20 2026-02-19T21:04:27.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 0x7f1bf811d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 0x7f1bf811d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33926/0 (socket says 10.20.193.90:33926) 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 -- 10.20.193.90:0/2871284948 learned_addr learned my addr 10.20.193.90:0/2871284948 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf7fff6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf8122b20 0x7f1bf8122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 -- 10.20.193.90:0/2871284948 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf8122b20 msgr2=0x7f1bf8122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf8122b20 0x7f1bf8122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 -- 10.20.193.90:0/2871284948 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1bf8115410 msgr2=0x7f1bf811d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1bf8115410 0x7f1bf811d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 -- 10.20.193.90:0/2871284948 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec00a660 con 0x7f1bf810f200 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf7fff6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf8122b20 0x7f1bf8122fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.732+0000 7f1bf77fe6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 0x7f1bf811d220 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be400b710 tx=0x7f1be400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.733+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be4004250 con 0x7f1bf810f200 2026-02-19T21:04:27.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.733+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1be4002d80 con 0x7f1bf810f200 2026-02-19T21:04:27.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.733+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf8163d10 con 0x7f1bf810f200 2026-02-19T21:04:27.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.733+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1be400ce20 con 0x7f1bf810f200 2026-02-19T21:04:27.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.733+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf81641f0 con 0x7f1bf810f200 2026-02-19T21:04:27.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.733+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf81104d0 con 0x7f1bf810f200 2026-02-19T21:04:27.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.734+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f1be40043b0 con 0x7f1bf810f200 2026-02-19T21:04:27.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.735+0000 7f1bf4ff96c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bcc0b56d0 0x7f1bcc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:27.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.735+0000 7f1bf6ffd6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bcc0b56d0 0x7f1bcc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:27.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.735+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f1be40e3800 con 0x7f1bf810f200 2026-02-19T21:04:27.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.736+0000 7f1bf6ffd6c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bcc0b56d0 0x7f1bcc0d5b80 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be8005980 tx=0x7f1be8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:27.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.736+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1be40a6610 con 0x7f1bf810f200 2026-02-19T21:04:27.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.851+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bf810fbf0 con 0x7f1bf810f200 2026-02-19T21:04:27.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.851+0000 7f1bf4ff96c0 1 -- 10.20.193.90:0/2871284948 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+10525 (secure 0 0 0) 0x7f1be40a97c0 con 0x7f1bf810f200 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.90:6840/2221645903,v1:10.20.193.90:6841/2221645903] up:boot 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.105:6838/25964077,v1:10.20.193.105:6839/25964077] up:boot 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: fsmap 12 up:standby 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-19T21:04:27.854 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:27.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:27 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:27.856 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:27.856 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":10,"btime":"2026-02-19T21:04:26:723397+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/2408399270","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":2408399270},{"type":"v1","addr":"10.20.193.90:6835","nonce":2408399270}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6837/248858987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":248858987},{"type":"v1","addr":"10.20.193.90:6837","nonce":248858987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6839/3725935308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":3725935308},{"type":"v1","addr":"10.20.193.90:6839","nonce":3725935308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6841/2221645903","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6840","nonce":2221645903},{"type":"v1","addr":"10.20.193.90:6841","nonce":2221645903}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6833/3709156295","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6832","nonce":3709156295},{"type":"v1","addr":"10.20.193.175:6833","nonce":3709156295}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6833/4254586612","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6832","nonce":4254586612},{"type":"v1","addr":"10.20.193.105:6833","nonce":4254586612}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6835/1761051629","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6834","nonce":1761051629},{"type":"v1","addr":"10.20.193.175:6835","nonce":1761051629}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6835/3619938278","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6834","nonce":3619938278},{"type":"v1","addr":"10.20.193.105:6835","nonce":3619938278}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6837/649777128","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6836","nonce":649777128},{"type":"v1","addr":"10.20.193.175:6837","nonce":649777128}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6839/1534233526","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6838","nonce":1534233526},{"type":"v1","addr":"10.20.193.175:6839","nonce":1534233526}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6837/2484410627","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6836","nonce":2484410627},{"type":"v1","addr":"10.20.193.105:6837","nonce":2484410627}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24638,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6839/25964077","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6838","nonce":25964077},{"type":"v1","addr":"10.20.193.105:6839","nonce":25964077}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2026-02-19T21:04:27.857 INFO:teuthology.orchestra.run.trial090.stderr:dumped fsmap epoch 10 2026-02-19T21:04:27.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bcc0b56d0 msgr2=0x7f1bcc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:27.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bcc0b56d0 0x7f1bcc0d5b80 secure :-1 s=READY pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be8005980 tx=0x7f1be8005910 comp rx=0 tx=0).stop 2026-02-19T21:04:27.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 msgr2=0x7f1bf811d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:27.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 0x7f1bf811d220 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1be400b710 tx=0x7f1be400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 shutdown_connections 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bcc0b56d0 0x7f1bcc0d5b80 unknown :-1 s=CLOSED pgs=128 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1bf8122b20 0x7f1bf8122fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1bf8115410 0x7f1bf811d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 --2- 10.20.193.90:0/2871284948 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1bf810f200 0x7f1bf811d220 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 >> 10.20.193.90:0/2871284948 conn(0x7f1bf80eca60 msgr2=0x7f1bf810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.852+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 shutdown_connections 2026-02-19T21:04:27.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:27.853+0000 7f1bfdb086c0 1 -- 10.20.193.90:0/2871284948 wait complete. 2026-02-19T21:04:27.894 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.90:6840/2221645903,v1:10.20.193.90:6841/2221645903] up:boot 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.105:6838/25964077,v1:10.20.193.105:6839/25964077] up:boot 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: fsmap 12 up:standby 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:28.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:27 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:28.016 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.90:6840/2221645903,v1:10.20.193.90:6841/2221645903] up:boot 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.105:6838/25964077,v1:10.20.193.105:6839/25964077] up:boot 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: fsmap 12 up:standby 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:28.025 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.026 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:28.026 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:28.026 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:28.026 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:27 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.136+0000 7fb78ef016c0 1 -- 10.20.193.90:0/4222979137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb788113180 msgr2=0x7fb788173b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.136+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/4222979137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb788113180 0x7fb788173b20 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=15831186299638734457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb78400aa70 tx=0x7fb78402fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- 10.20.193.90:0/4222979137 shutdown_connections 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/4222979137 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb788113180 0x7fb788173b20 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=15831186299638734457 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/4222979137 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb78810d960 0x7fb7881129a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/4222979137 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb78810cf70 0x7fb78810d340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- 10.20.193.90:0/4222979137 >> 10.20.193.90:0/4222979137 conn(0x7fb7880ea870 msgr2=0x7fb78810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:28.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- 10.20.193.90:0/4222979137 shutdown_connections 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- 10.20.193.90:0/4222979137 wait complete. 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 Processor -- start 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- start start 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 0x7fb7880f2a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb788113180 0x7fb788173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb7880f3030 0x7fb7880f8300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880f3720 con 0x7fb78810cf70 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880f8840 con 0x7fb7880f3030 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78ef016c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880f8a00 con 0x7fb788113180 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 0x7fb7880f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 0x7fb7880f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33958/0 (socket says 10.20.193.90:33958) 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 -- 10.20.193.90:0/162155718 learned_addr learned my addr 10.20.193.90:0/162155718 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78d4736c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb7880f3030 0x7fb7880f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb77ffff6c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb788113180 0x7fb788173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 -- 10.20.193.90:0/162155718 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb788113180 msgr2=0x7fb788173a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb788113180 0x7fb788173a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 -- 10.20.193.90:0/162155718 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb7880f3030 msgr2=0x7fb7880f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb7880f3030 0x7fb7880f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.137+0000 7fb78cc726c0 1 -- 10.20.193.90:0/162155718 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78400a660 con 0x7fb78810cf70 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb77ffff6c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb788113180 0x7fb788173a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb78d4736c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb7880f3030 0x7fb7880f8300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb78cc726c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 0x7fb7880f2a00 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb77800b710 tx=0x7fb77800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb778004250 con 0x7fb78810cf70 2026-02-19T21:04:28.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7880f8ce0 con 0x7fb78810cf70 2026-02-19T21:04:28.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb778009070 con 0x7fb78810cf70 2026-02-19T21:04:28.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb77800ccd0 con 0x7fb78810cf70 2026-02-19T21:04:28.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7880f9470 con 0x7fb78810cf70 2026-02-19T21:04:28.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.138+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78810e240 con 0x7fb78810cf70 2026-02-19T21:04:28.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.140+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fb7780028c0 con 0x7fb78810cf70 2026-02-19T21:04:28.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.140+0000 7fb77dffb6c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7640b5650 0x7fb7640d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.141+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7fb7780e38e0 con 0x7fb78810cf70 2026-02-19T21:04:28.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.141+0000 7fb77ffff6c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7640b5650 0x7fb7640d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.141+0000 7fb77ffff6c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7640b5650 0x7fb7640d5b00 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7880f9390 tx=0x7fb770009060 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:28.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.141+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb7780a66f0 con 0x7fb78810cf70 2026-02-19T21:04:28.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.232+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb7880f3b50 con 0x7fb78810cf70 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.233+0000 7fb77dffb6c0 1 -- 10.20.193.90:0/162155718 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fb77800ce60 con 0x7fb78810cf70 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stdout:[ 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stdout: { 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stdout: "poolnum": 1, 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stdout: "poolname": ".mgr" 2026-02-19T21:04:28.235 INFO:teuthology.orchestra.run.trial090.stdout: } 2026-02-19T21:04:28.236 INFO:teuthology.orchestra.run.trial090.stdout:] 2026-02-19T21:04:28.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7640b5650 msgr2=0x7fb7640d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7640b5650 0x7fb7640d5b00 secure :-1 s=READY pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7880f9390 tx=0x7fb770009060 comp rx=0 tx=0).stop 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 msgr2=0x7fb7880f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 0x7fb7880f2a00 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb77800b710 tx=0x7fb77800bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 shutdown_connections 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb7640b5650 0x7fb7640d5b00 unknown :-1 s=CLOSED pgs=129 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb7880f3030 0x7fb7880f8300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb788113180 0x7fb788173a20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 --2- 10.20.193.90:0/162155718 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb78810cf70 0x7fb7880f2a00 unknown :-1 s=CLOSED pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 >> 10.20.193.90:0/162155718 conn(0x7fb7880ea870 msgr2=0x7fb78810b670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:28.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 shutdown_connections 2026-02-19T21:04:28.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.234+0000 7fb78ef016c0 1 -- 10.20.193.90:0/162155718 wait complete. 2026-02-19T21:04:28.274 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-19T21:04:28.274 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-19T21:04:28.403 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- 10.20.193.90:0/838045013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f032810f200 msgr2=0x7f032810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- 10.20.193.90:0/838045013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f032810f200 0x7f032810f5d0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=4309812126693293817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03180099a0 tx=0x7f031802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- 10.20.193.90:0/838045013 shutdown_connections 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- 10.20.193.90:0/838045013 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0328115410 0x7f0328175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- 10.20.193.90:0/838045013 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f032810fbf0 0x7f0328114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- 10.20.193.90:0/838045013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f032810f200 0x7f032810f5d0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=4309812126693293817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- 10.20.193.90:0/838045013 >> 10.20.193.90:0/838045013 conn(0x7f03280eca60 msgr2=0x7f032810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:28.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- 10.20.193.90:0/838045013 shutdown_connections 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- 10.20.193.90:0/838045013 wait complete. 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 Processor -- start 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- start start 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f032810f200 0x7f032811d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 0x7f032811d810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0328122bd0 0x7f0328123070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f03281235b0 con 0x7f0328115410 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0328123720 con 0x7f0328122bd0 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032f2146c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f03281238e0 con 0x7f032810f200 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f031ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 0x7f032811d810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f031ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 0x7f032811d810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33976/0 (socket says 10.20.193.90:33976) 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f031ffff6c0 1 -- 10.20.193.90:0/443352330 learned_addr learned my addr 10.20.193.90:0/443352330 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032cf856c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f032810f200 0x7f032811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.519+0000 7f032d7866c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0328122bd0 0x7f0328123070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031ffff6c0 1 -- 10.20.193.90:0/443352330 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f032810f200 msgr2=0x7f032811d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031ffff6c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f032810f200 0x7f032811d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031ffff6c0 1 -- 10.20.193.90:0/443352330 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0328122bd0 msgr2=0x7f0328123070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031ffff6c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0328122bd0 0x7f0328123070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031ffff6c0 1 -- 10.20.193.90:0/443352330 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0318009590 con 0x7f0328115410 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031ffff6c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 0x7f032811d810 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f031000b650 tx=0x7f031000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f03100044a0 con 0x7f0328115410 2026-02-19T21:04:28.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0310009030 con 0x7f0328115410 2026-02-19T21:04:28.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0328163d60 con 0x7f0328115410 2026-02-19T21:04:28.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f031000cc10 con 0x7f0328115410 2026-02-19T21:04:28.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0328164290 con 0x7f0328115410 2026-02-19T21:04:28.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.520+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03281104d0 con 0x7f0328115410 2026-02-19T21:04:28.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.522+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f03100026b0 con 0x7f0328115410 2026-02-19T21:04:28.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.522+0000 7f031dffb6c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f03040b56d0 0x7f03040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:28.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.523+0000 7f032cf856c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f03040b56d0 0x7f03040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:28.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.523+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7119+0+0 (secure 0 0 0) 0x7f03100e36b0 con 0x7f0328115410 2026-02-19T21:04:28.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.523+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f03100a9490 con 0x7f0328115410 2026-02-19T21:04:28.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.523+0000 7f032cf856c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f03040b56d0 0x7f03040d5b80 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03180092e0 tx=0x7f0318005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:28.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:28.614+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f032811e420 con 0x7f0328115410 2026-02-19T21:04:28.837 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:28.837 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:28.837 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2871284948' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:28.837 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/162155718' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-19T21:04:28.837 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.837 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:28.838 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:28 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/443352330' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-19T21:04:29.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2871284948' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/162155718' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:29.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:29.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:29.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:29.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:29.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:28 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/443352330' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2871284948' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/162155718' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:04:29.158 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:28 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/443352330' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-19T21:04:29.402 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.399+0000 7f031dffb6c0 1 -- 10.20.193.90:0/443352330 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f03100a9670 con 0x7f0328115410 2026-02-19T21:04:29.402 INFO:teuthology.orchestra.run.trial090.stderr:pool 'cephfs_metadata' created 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f03040b56d0 msgr2=0x7f03040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f03040b56d0 0x7f03040d5b80 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03180092e0 tx=0x7f0318005c00 comp rx=0 tx=0).stop 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 msgr2=0x7f032811d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 0x7f032811d810 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f031000b650 tx=0x7f031000bb20 comp rx=0 tx=0).stop 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 shutdown_connections 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f03040b56d0 0x7f03040d5b80 unknown :-1 s=CLOSED pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0328122bd0 0x7f0328123070 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0328115410 0x7f032811d810 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 --2- 10.20.193.90:0/443352330 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f032810f200 0x7f032811d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 >> 10.20.193.90:0/443352330 conn(0x7f03280eca60 msgr2=0x7f032810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:29.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 shutdown_connections 2026-02-19T21:04:29.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.404+0000 7f032f2146c0 1 -- 10.20.193.90:0/443352330 wait complete. 2026-02-19T21:04:29.444 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-19T21:04:29.568 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:29.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- 10.20.193.90:0/927192268 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f025010cf70 msgr2=0x7f025010d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- 10.20.193.90:0/927192268 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f025010cf70 0x7f025010d340 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=12705211034482437123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02400099a0 tx=0x7f024002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- 10.20.193.90:0/927192268 shutdown_connections 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- 10.20.193.90:0/927192268 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0250113180 0x7f0250173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- 10.20.193.90:0/927192268 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f025010d960 0x7f02501129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- 10.20.193.90:0/927192268 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f025010cf70 0x7f025010d340 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=12705211034482437123 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- 10.20.193.90:0/927192268 >> 10.20.193.90:0/927192268 conn(0x7f02500ea870 msgr2=0x7f025010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- 10.20.193.90:0/927192268 shutdown_connections 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- 10.20.193.90:0/927192268 wait complete. 2026-02-19T21:04:29.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 Processor -- start 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- start start 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f025010cf70 0x7f02500606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0250113180 0x7f0250060c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 0x7f0250163330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0250163870 con 0x7f0250061140 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02501639e0 con 0x7f0250113180 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f025745b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0250163ba0 con 0x7f025010cf70 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f02559cd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 0x7f0250163330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f02559cd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 0x7f0250163330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33984/0 (socket says 10.20.193.90:33984) 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f02559cd6c0 1 -- 10.20.193.90:0/3909298750 learned_addr learned my addr 10.20.193.90:0/3909298750 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f02551cc6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f025010cf70 0x7f02500606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:29.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.689+0000 7f02549cb6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0250113180 0x7f0250060c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f02559cd6c0 1 -- 10.20.193.90:0/3909298750 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f025010cf70 msgr2=0x7f02500606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f02559cd6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f025010cf70 0x7f02500606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f02559cd6c0 1 -- 10.20.193.90:0/3909298750 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0250113180 msgr2=0x7f0250060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f02559cd6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0250113180 0x7f0250060c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f02559cd6c0 1 -- 10.20.193.90:0/3909298750 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0240009590 con 0x7f0250061140 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f02559cd6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 0x7f0250163330 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f024c006ea0 tx=0x7f024c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f024c003a30 con 0x7f0250061140 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f024c0054f0 con 0x7f0250061140 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0250163e80 con 0x7f0250061140 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f024c00dcd0 con 0x7f0250061140 2026-02-19T21:04:29.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02501643b0 con 0x7f0250061140 2026-02-19T21:04:29.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.690+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f025010e240 con 0x7f0250061140 2026-02-19T21:04:29.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.692+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f024c005030 con 0x7f0250061140 2026-02-19T21:04:29.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.692+0000 7f023e7fc6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f022c0b56d0 0x7f022c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:29.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.693+0000 7f02551cc6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f022c0b56d0 0x7f022c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:29.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.693+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7492+0+0 (secure 0 0 0) 0x7f024c0e4840 con 0x7f0250061140 2026-02-19T21:04:29.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.693+0000 7f02551cc6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f022c0b56d0 0x7f022c0d5b80 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0240005b40 tx=0x7f02400023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:29.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.693+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f024c0a74d0 con 0x7f0250061140 2026-02-19T21:04:29.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:29.786+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f025010d340 con 0x7f0250061140 2026-02-19T21:04:30.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:29 trial175 ceph-mon[34116]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:30.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:29 trial175 ceph-mon[34116]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:30.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:29 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/443352330' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-19T21:04:30.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:29 trial175 ceph-mon[34116]: osdmap e72: 12 total, 12 up, 12 in 2026-02-19T21:04:30.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:29 trial105 ceph-mon[33883]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:30.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:29 trial105 ceph-mon[33883]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:30.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:29 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/443352330' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-19T21:04:30.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:29 trial105 ceph-mon[33883]: osdmap e72: 12 total, 12 up, 12 in 2026-02-19T21:04:30.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:29 trial090 ceph-mon[31759]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:30.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:29 trial090 ceph-mon[31759]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:30.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:29 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/443352330' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-19T21:04:30.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:29 trial090 ceph-mon[31759]: osdmap e72: 12 total, 12 up, 12 in 2026-02-19T21:04:30.403 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.401+0000 7f023e7fc6c0 1 -- 10.20.193.90:0/3909298750 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7f024c00de60 con 0x7f0250061140 2026-02-19T21:04:30.404 INFO:teuthology.orchestra.run.trial090.stderr:pool 'cephfs_data' created 2026-02-19T21:04:30.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f022c0b56d0 msgr2=0x7f022c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f022c0b56d0 0x7f022c0d5b80 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0240005b40 tx=0x7f02400023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 msgr2=0x7f0250163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 0x7f0250163330 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f024c006ea0 tx=0x7f024c00cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 shutdown_connections 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f022c0b56d0 0x7f022c0d5b80 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0250061140 0x7f0250163330 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0250113180 0x7f0250060c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 --2- 10.20.193.90:0/3909298750 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f025010cf70 0x7f02500606c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.404+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 >> 10.20.193.90:0/3909298750 conn(0x7f02500ea870 msgr2=0x7f025010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:30.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.405+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 shutdown_connections 2026-02-19T21:04:30.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.405+0000 7f025745b6c0 1 -- 10.20.193.90:0/3909298750 wait complete. 2026-02-19T21:04:30.451 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-19T21:04:30.574 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/2888099502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb810f200 msgr2=0x7f4cb810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/2888099502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb810f200 0x7f4cb810f5d0 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=12398731950434074237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cac0099a0 tx=0x7f4cac02ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/2888099502 shutdown_connections 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/2888099502 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4cb8115410 0x7f4cb8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/2888099502 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4cb810fbf0 0x7f4cb8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/2888099502 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb810f200 0x7f4cb810f5d0 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=12398731950434074237 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/2888099502 >> 10.20.193.90:0/2888099502 conn(0x7f4cb80ecac0 msgr2=0x7f4cb810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:30.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/2888099502 shutdown_connections 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.690+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/2888099502 wait complete. 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 Processor -- start 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 -- start start 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4cb810f200 0x7f4cb811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4cb8115410 0x7f4cb811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 0x7f4cb81230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8123610 con 0x7f4cb8122c30 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8123780 con 0x7f4cb8115410 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8123940 con 0x7f4cb810f200 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 0x7f4cb81230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 0x7f4cb81230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34006/0 (socket says 10.20.193.90:34006) 2026-02-19T21:04:30.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 -- 10.20.193.90:0/1836953804 learned_addr learned my addr 10.20.193.90:0/1836953804 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb6ffd6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4cb810f200 0x7f4cb811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb67fc6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4cb8115410 0x7f4cb811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 -- 10.20.193.90:0/1836953804 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4cb810f200 msgr2=0x7f4cb811d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4cb810f200 0x7f4cb811d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 -- 10.20.193.90:0/1836953804 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4cb8115410 msgr2=0x7f4cb811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4cb8115410 0x7f4cb811d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 -- 10.20.193.90:0/1836953804 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac009590 con 0x7f4cb8122c30 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cb77fe6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 0x7f4cb81230d0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ca8006ea0 tx=0x7f4ca800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ca8003a30 con 0x7f4cb8122c30 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb8163dc0 con 0x7f4cb8122c30 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4ca80054f0 con 0x7f4cb8122c30 2026-02-19T21:04:30.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.691+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ca800dcd0 con 0x7f4cb8122c30 2026-02-19T21:04:30.698 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.692+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81642f0 con 0x7f4cb8122c30 2026-02-19T21:04:30.698 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.692+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb81104d0 con 0x7f4cb8122c30 2026-02-19T21:04:30.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.693+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f4ca8005030 con 0x7f4cb8122c30 2026-02-19T21:04:30.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.694+0000 7f4c97fff6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4c8c0b5650 0x7f4c8c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:30.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.694+0000 7f4cb6ffd6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4c8c0b5650 0x7f4c8c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:30.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.694+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7877+0+0 (secure 0 0 0) 0x7f4ca80e4a30 con 0x7f4cb8122c30 2026-02-19T21:04:30.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.694+0000 7f4cb6ffd6c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4c8c0b5650 0x7f4c8c0d5b00 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cac005b40 tx=0x7f4cac0023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:30.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.694+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4ca80aafe0 con 0x7f4cb8122c30 2026-02-19T21:04:30.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:30.810+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4cb811e480 con 0x7f4cb8122c30 2026-02-19T21:04:31.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:30 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3909298750' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-19T21:04:31.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:30 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3909298750' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-19T21:04:31.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:30 trial175 ceph-mon[34116]: osdmap e73: 12 total, 12 up, 12 in 2026-02-19T21:04:31.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:30 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3909298750' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-19T21:04:31.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:30 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3909298750' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-19T21:04:31.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:30 trial105 ceph-mon[33883]: osdmap e73: 12 total, 12 up, 12 in 2026-02-19T21:04:31.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:30 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3909298750' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-19T21:04:31.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:30 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3909298750' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-19T21:04:31.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:30 trial090 ceph-mon[31759]: osdmap e73: 12 total, 12 up, 12 in 2026-02-19T21:04:31.736 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.734+0000 7f4c97fff6c0 1 -- 10.20.193.90:0/1836953804 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v11) ==== 172+0+0 (secure 0 0 0) 0x7f4ca800de60 con 0x7f4cb8122c30 2026-02-19T21:04:31.736 INFO:teuthology.orchestra.run.trial090.stderr:new fs with metadata pool 2 and data pool 3 2026-02-19T21:04:31.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4c8c0b5650 msgr2=0x7f4c8c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4c8c0b5650 0x7f4c8c0d5b00 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cac005b40 tx=0x7f4cac0023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 msgr2=0x7f4cb81230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 0x7f4cb81230d0 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ca8006ea0 tx=0x7f4ca800cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 shutdown_connections 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4c8c0b5650 0x7f4c8c0d5b00 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4cb8122c30 0x7f4cb81230d0 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4cb8115410 0x7f4cb811d870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 --2- 10.20.193.90:0/1836953804 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4cb810f200 0x7f4cb811d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 >> 10.20.193.90:0/1836953804 conn(0x7f4cb80ecac0 msgr2=0x7f4cb810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 shutdown_connections 2026-02-19T21:04:31.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:31.736+0000 7f4cbd5a36c0 1 -- 10.20.193.90:0/1836953804 wait complete. 2026-02-19T21:04:31.779 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T21:04:31.902 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:32.014 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:31 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1836953804' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-19T21:04:32.014 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:31 trial090 ceph-mon[31759]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-19T21:04:32.014 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:31 trial090 ceph-mon[31759]: pgmap v173: 97 pgs: 11 creating+peering, 85 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:32.014 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:32.014 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:31 trial090 ceph-mon[31759]: osdmap e74: 12 total, 12 up, 12 in 2026-02-19T21:04:32.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:31 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1836953804' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-19T21:04:32.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:31 trial175 ceph-mon[34116]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-19T21:04:32.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:31 trial175 ceph-mon[34116]: pgmap v173: 97 pgs: 11 creating+peering, 85 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:32.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:32.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:31 trial175 ceph-mon[34116]: osdmap e74: 12 total, 12 up, 12 in 2026-02-19T21:04:32.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/379621474 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0113180 msgr2=0x7f7be0173b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/379621474 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0113180 0x7f7be0173b20 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=12989457301892083630 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd400aa70 tx=0x7f7bd402fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/379621474 shutdown_connections 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/379621474 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0113180 0x7f7be0173b20 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=12989457301892083630 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/379621474 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010d960 0x7f7be01129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/379621474 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7be010cf70 0x7f7be010d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/379621474 >> 10.20.193.90:0/379621474 conn(0x7f7be00ea870 msgr2=0x7f7be010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/379621474 shutdown_connections 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/379621474 wait complete. 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 Processor -- start 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- start start 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010cf70 0x7f7be011af50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7be0113180 0x7f7be011b490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 0x7f7be0120cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0121260 con 0x7f7be0120850 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7be01213d0 con 0x7f7be010cf70 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7be5fd56c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7be0121590 con 0x7f7be0113180 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7bdffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 0x7f7be0120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.016+0000 7f7bdffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 0x7f7be0120cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34014/0 (socket says 10.20.193.90:34014) 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 -- 10.20.193.90:0/3522499172 learned_addr learned my addr 10.20.193.90:0/3522499172 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdeffd6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7be0113180 0x7f7be011b490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 -- 10.20.193.90:0/3522499172 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7be0113180 msgr2=0x7f7be011b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7be0113180 0x7f7be011b490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 -- 10.20.193.90:0/3522499172 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010cf70 msgr2=0x7f7be011af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdf7fe6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010cf70 0x7f7be011af50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010cf70 0x7f7be011af50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 -- 10.20.193.90:0/3522499172 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd400a660 con 0x7f7be0120850 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdf7fe6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010cf70 0x7f7be011af50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdffff6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 0x7f7be0120cf0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd4006ec0 tx=0x7f7bd4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd4003c40 con 0x7f7be0120850 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7bd4005780 con 0x7f7be0120850 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be01619e0 con 0x7f7be0120850 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bd40382f0 con 0x7f7be0120850 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be0161e10 con 0x7f7be0120850 2026-02-19T21:04:32.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.017+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be010e240 con 0x7f7be0120850 2026-02-19T21:04:32.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.019+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f7bd4008260 con 0x7f7be0120850 2026-02-19T21:04:32.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.020+0000 7f7bdcff96c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7bb40b5650 0x7f7bb40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.020+0000 7f7bdf7fe6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7bb40b5650 0x7f7bb40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.020+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7977+0+0 (secure 0 0 0) 0x7f7bd4108f30 con 0x7f7be0120850 2026-02-19T21:04:32.025 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.020+0000 7f7bdf7fe6c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7bb40b5650 0x7f7bb40d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc004750 tx=0x7f7bcc005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:32.025 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.020+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7bd40cb9e0 con 0x7f7be0120850 2026-02-19T21:04:32.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.113+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7be010d340 con 0x7f7be0120850 2026-02-19T21:04:32.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.114+0000 7f7bdcff96c0 1 -- 10.20.193.90:0/3522499172 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22341 (secure 0 0 0) 0x7f7bd40ceb90 con 0x7f7be0120850 2026-02-19T21:04:32.117 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:32.117 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":74,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","created":"2026-02-19T21:02:03.870776+0000","modified":"2026-02-19T21:04:30.811998+0000","last_up_change":"2026-02-19T21:04:15.914313+0000","last_in_change":"2026-02-19T21:04:07.215369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T21:03:11.280767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-19T21:04:28.620551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-19T21:04:29.792203+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9447a1db-db31-41c0-8732-78156b284c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6803","nonce":300222624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6805","nonce":300222624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6809","nonce":300222624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6807","nonce":300222624}]},"public_addr":"10.20.193.90:6803/300222624","cluster_addr":"10.20.193.90:6805/300222624","heartbeat_back_addr":"10.20.193.90:6809/300222624","heartbeat_front_addr":"10.20.193.90:6807/300222624","state":["exists","up"]},{"osd":1,"uuid":"2ceb6ac4-0471-49bc-b664-7b5053f54250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6801","nonce":515149626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6803","nonce":515149626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6807","nonce":515149626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6805","nonce":515149626}]},"public_addr":"10.20.193.105:6801/515149626","cluster_addr":"10.20.193.105:6803/515149626","heartbeat_back_addr":"10.20.193.105:6807/515149626","heartbeat_front_addr":"10.20.193.105:6805/515149626","state":["exists","up"]},{"osd":2,"uuid":"8ded8050-146f-41a3-a2e7-974118414769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6800","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6801","nonce":2163707084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6802","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6803","nonce":2163707084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6806","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6807","nonce":2163707084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6804","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6805","nonce":2163707084}]},"public_addr":"10.20.193.175:6801/2163707084","cluster_addr":"10.20.193.175:6803/2163707084","heartbeat_back_addr":"10.20.193.175:6807/2163707084","heartbeat_front_addr":"10.20.193.175:6805/2163707084","state":["exists","up"]},{"osd":3,"uuid":"556df040-373e-4795-af5e-297ede87881b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6811","nonce":1075832494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6813","nonce":1075832494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6817","nonce":1075832494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6815","nonce":1075832494}]},"public_addr":"10.20.193.90:6811/1075832494","cluster_addr":"10.20.193.90:6813/1075832494","heartbeat_back_addr":"10.20.193.90:6817/1075832494","heartbeat_front_addr":"10.20.193.90:6815/1075832494","state":["exists","up"]},{"osd":4,"uuid":"a0776450-d439-4c5d-a67d-0ae50bb72319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6809","nonce":891701520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6811","nonce":891701520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6815","nonce":891701520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6813","nonce":891701520}]},"public_addr":"10.20.193.105:6809/891701520","cluster_addr":"10.20.193.105:6811/891701520","heartbeat_back_addr":"10.20.193.105:6815/891701520","heartbeat_front_addr":"10.20.193.105:6813/891701520","state":["exists","up"]},{"osd":5,"uuid":"3450f832-0b90-45d7-a92d-b74809259564","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6808","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6809","nonce":1433153714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6810","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6811","nonce":1433153714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6814","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6815","nonce":1433153714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6812","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6813","nonce":1433153714}]},"public_addr":"10.20.193.175:6809/1433153714","cluster_addr":"10.20.193.175:6811/1433153714","heartbeat_back_addr":"10.20.193.175:6815/1433153714","heartbeat_front_addr":"10.20.193.175:6813/1433153714","state":["exists","up"]},{"osd":6,"uuid":"9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6819","nonce":4121266153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6821","nonce":4121266153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6825","nonce":4121266153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6823","nonce":4121266153}]},"public_addr":"10.20.193.90:6819/4121266153","cluster_addr":"10.20.193.90:6821/4121266153","heartbeat_back_addr":"10.20.193.90:6825/4121266153","heartbeat_front_addr":"10.20.193.90:6823/4121266153","state":["exists","up"]},{"osd":7,"uuid":"6b119453-b94f-441f-8685-a992fe2922ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6817","nonce":3597166844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6818","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6819","nonce":3597166844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6822","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6823","nonce":3597166844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6820","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6821","nonce":3597166844}]},"public_addr":"10.20.193.105:6817/3597166844","cluster_addr":"10.20.193.105:6819/3597166844","heartbeat_back_addr":"10.20.193.105:6823/3597166844","heartbeat_front_addr":"10.20.193.105:6821/3597166844","state":["exists","up"]},{"osd":8,"uuid":"fdfc8889-7eda-48ef-ae9d-5ec9cb798a56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6816","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6817","nonce":711294156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6818","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6819","nonce":711294156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6822","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6823","nonce":711294156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6820","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6821","nonce":711294156}]},"public_addr":"10.20.193.175:6817/711294156","cluster_addr":"10.20.193.175:6819/711294156","heartbeat_back_addr":"10.20.193.175:6823/711294156","heartbeat_front_addr":"10.20.193.175:6821/711294156","state":["exists","up"]},{"osd":9,"uuid":"bfa36c36-03aa-4363-85f7-b4cd9450b612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6827","nonce":72013082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6829","nonce":72013082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6833","nonce":72013082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6831","nonce":72013082}]},"public_addr":"10.20.193.90:6827/72013082","cluster_addr":"10.20.193.90:6829/72013082","heartbeat_back_addr":"10.20.193.90:6833/72013082","heartbeat_front_addr":"10.20.193.90:6831/72013082","state":["exists","up"]},{"osd":10,"uuid":"43e47e1a-7160-446c-8fe3-8a20cc2a4c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6824","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6825","nonce":3923796147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6826","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6827","nonce":3923796147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6830","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6831","nonce":3923796147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6828","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6829","nonce":3923796147}]},"public_addr":"10.20.193.105:6825/3923796147","cluster_addr":"10.20.193.105:6827/3923796147","heartbeat_back_addr":"10.20.193.105:6831/3923796147","heartbeat_front_addr":"10.20.193.105:6829/3923796147","state":["exists","up"]},{"osd":11,"uuid":"b789e6a7-be92-4cae-a3a0-d6eebe9b8629","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6824","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6825","nonce":3785438366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6826","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6827","nonce":3785438366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6830","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6831","nonce":3785438366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6828","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6829","nonce":3785438366}]},"public_addr":"10.20.193.175:6825/3785438366","cluster_addr":"10.20.193.175:6827/3785438366","heartbeat_back_addr":"10.20.193.175:6831/3785438366","heartbeat_front_addr":"10.20.193.175:6829/3785438366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:02:53.889642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:00.781533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:08.187332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:15.317071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:22.497099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:29.848931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:37.269086+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:44.452146+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:51.824076+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:59.325996+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:06.588398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:14.010218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/1864372684":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6800/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1997858222":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/66846304":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6801/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6800/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/2504907435":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6801/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1301435029":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/4201652812":"2026-02-20T21:02:09.876469+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7bb40b5650 msgr2=0x7f7bb40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7bb40b5650 0x7f7bb40d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bcc004750 tx=0x7f7bcc005f10 comp rx=0 tx=0).stop 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 msgr2=0x7f7be0120cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 0x7f7be0120cf0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bd4006ec0 tx=0x7f7bd4005520 comp rx=0 tx=0).stop 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 shutdown_connections 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7bb40b5650 0x7f7bb40d5b00 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7be0120850 0x7f7be0120cf0 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7be0113180 0x7f7be011b490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 --2- 10.20.193.90:0/3522499172 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7be010cf70 0x7f7be011af50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 >> 10.20.193.90:0/3522499172 conn(0x7f7be00ea870 msgr2=0x7f7be010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:32.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 shutdown_connections 2026-02-19T21:04:32.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.115+0000 7f7be5fd56c0 1 -- 10.20.193.90:0/3522499172 wait complete. 2026-02-19T21:04:32.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:31 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1836953804' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-19T21:04:32.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:31 trial105 ceph-mon[33883]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-19T21:04:32.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:31 trial105 ceph-mon[33883]: pgmap v173: 97 pgs: 11 creating+peering, 85 unknown, 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:32.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:04:32.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:31 trial105 ceph-mon[33883]: osdmap e74: 12 total, 12 up, 12 in 2026-02-19T21:04:32.156 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T21:04:32.278 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:32.388 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2796635073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 msgr2=0x7fdae4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.388 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2796635073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae4175db0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=13431024783832155153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdae000aa70 tx=0x7fdae002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.388 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2796635073 shutdown_connections 2026-02-19T21:04:32.388 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2796635073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae4175db0 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=13431024783832155153 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.388 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2796635073 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410fbf0 0x7fdae4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.388 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2796635073 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdae410f200 0x7fdae410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2796635073 >> 10.20.193.90:0/2796635073 conn(0x7fdae40eca60 msgr2=0x7fdae410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2796635073 shutdown_connections 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.383+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2796635073 wait complete. 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 Processor -- start 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 -- start start 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410f200 0x7fdae411d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae411d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdae4122af0 0x7fdae4122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4123500 con 0x7fdae4115410 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4123670 con 0x7fdae410f200 2026-02-19T21:04:32.389 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdae4123830 con 0x7fdae4122af0 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae411d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae411d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34028/0 (socket says 10.20.193.90:34028) 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 -- 10.20.193.90:0/2376959496 learned_addr learned my addr 10.20.193.90:0/2376959496 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae9a896c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410f200 0x7fdae411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 -- 10.20.193.90:0/2376959496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdae4122af0 msgr2=0x7fdae4122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdae4122af0 0x7fdae4122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 -- 10.20.193.90:0/2376959496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410f200 msgr2=0x7fdae411d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410f200 0x7fdae411d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 -- 10.20.193.90:0/2376959496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae000a660 con 0x7fdae4115410 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae9a896c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410f200 0x7fdae411d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdae92886c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae411d730 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdad8005dc0 tx=0x7fdad800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:32.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdad8004250 con 0x7fdae4115410 2026-02-19T21:04:32.391 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdad8009070 con 0x7fdae4115410 2026-02-19T21:04:32.391 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae4163ce0 con 0x7fdae4115410 2026-02-19T21:04:32.391 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdad800cd50 con 0x7fdae4115410 2026-02-19T21:04:32.391 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.384+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae4164170 con 0x7fdae4115410 2026-02-19T21:04:32.391 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.385+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae41104d0 con 0x7fdae4115410 2026-02-19T21:04:32.391 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.386+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fdad80028c0 con 0x7fdae4115410 2026-02-19T21:04:32.392 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.387+0000 7fdad2ffd6c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdac00b5650 0x7fdac00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.392 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.387+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fdad80e3b50 con 0x7fdae4115410 2026-02-19T21:04:32.392 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.387+0000 7fdae9a896c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdac00b5650 0x7fdac00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.392 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.387+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdad80a6600 con 0x7fdae4115410 2026-02-19T21:04:32.392 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.387+0000 7fdae9a896c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdac00b5650 0x7fdac00d5b00 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdad4004750 tx=0x7fdad4005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:32.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.480+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdae410f5d0 con 0x7fdae4115410 2026-02-19T21:04:32.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.480+0000 7fdad2ffd6c0 1 -- 10.20.193.90:0/2376959496 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22328 (secure 0 0 0) 0x7fdad80a97b0 con 0x7fdae4115410 2026-02-19T21:04:32.482 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:32.483 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":75,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","created":"2026-02-19T21:02:03.870776+0000","modified":"2026-02-19T21:04:32.278599+0000","last_up_change":"2026-02-19T21:04:15.914313+0000","last_in_change":"2026-02-19T21:04:07.215369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T21:03:11.280767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-19T21:04:28.620551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-19T21:04:29.792203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9447a1db-db31-41c0-8732-78156b284c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6803","nonce":300222624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6805","nonce":300222624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6809","nonce":300222624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6807","nonce":300222624}]},"public_addr":"10.20.193.90:6803/300222624","cluster_addr":"10.20.193.90:6805/300222624","heartbeat_back_addr":"10.20.193.90:6809/300222624","heartbeat_front_addr":"10.20.193.90:6807/300222624","state":["exists","up"]},{"osd":1,"uuid":"2ceb6ac4-0471-49bc-b664-7b5053f54250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6801","nonce":515149626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6803","nonce":515149626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6807","nonce":515149626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6805","nonce":515149626}]},"public_addr":"10.20.193.105:6801/515149626","cluster_addr":"10.20.193.105:6803/515149626","heartbeat_back_addr":"10.20.193.105:6807/515149626","heartbeat_front_addr":"10.20.193.105:6805/515149626","state":["exists","up"]},{"osd":2,"uuid":"8ded8050-146f-41a3-a2e7-974118414769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6800","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6801","nonce":2163707084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6802","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6803","nonce":2163707084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6806","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6807","nonce":2163707084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6804","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6805","nonce":2163707084}]},"public_addr":"10.20.193.175:6801/2163707084","cluster_addr":"10.20.193.175:6803/2163707084","heartbeat_back_addr":"10.20.193.175:6807/2163707084","heartbeat_front_addr":"10.20.193.175:6805/2163707084","state":["exists","up"]},{"osd":3,"uuid":"556df040-373e-4795-af5e-297ede87881b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6811","nonce":1075832494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6813","nonce":1075832494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6817","nonce":1075832494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6815","nonce":1075832494}]},"public_addr":"10.20.193.90:6811/1075832494","cluster_addr":"10.20.193.90:6813/1075832494","heartbeat_back_addr":"10.20.193.90:6817/1075832494","heartbeat_front_addr":"10.20.193.90:6815/1075832494","state":["exists","up"]},{"osd":4,"uuid":"a0776450-d439-4c5d-a67d-0ae50bb72319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6809","nonce":891701520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6811","nonce":891701520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6815","nonce":891701520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6813","nonce":891701520}]},"public_addr":"10.20.193.105:6809/891701520","cluster_addr":"10.20.193.105:6811/891701520","heartbeat_back_addr":"10.20.193.105:6815/891701520","heartbeat_front_addr":"10.20.193.105:6813/891701520","state":["exists","up"]},{"osd":5,"uuid":"3450f832-0b90-45d7-a92d-b74809259564","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6808","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6809","nonce":1433153714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6810","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6811","nonce":1433153714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6814","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6815","nonce":1433153714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6812","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6813","nonce":1433153714}]},"public_addr":"10.20.193.175:6809/1433153714","cluster_addr":"10.20.193.175:6811/1433153714","heartbeat_back_addr":"10.20.193.175:6815/1433153714","heartbeat_front_addr":"10.20.193.175:6813/1433153714","state":["exists","up"]},{"osd":6,"uuid":"9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6819","nonce":4121266153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6821","nonce":4121266153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6825","nonce":4121266153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6823","nonce":4121266153}]},"public_addr":"10.20.193.90:6819/4121266153","cluster_addr":"10.20.193.90:6821/4121266153","heartbeat_back_addr":"10.20.193.90:6825/4121266153","heartbeat_front_addr":"10.20.193.90:6823/4121266153","state":["exists","up"]},{"osd":7,"uuid":"6b119453-b94f-441f-8685-a992fe2922ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6817","nonce":3597166844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6818","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6819","nonce":3597166844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6822","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6823","nonce":3597166844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6820","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6821","nonce":3597166844}]},"public_addr":"10.20.193.105:6817/3597166844","cluster_addr":"10.20.193.105:6819/3597166844","heartbeat_back_addr":"10.20.193.105:6823/3597166844","heartbeat_front_addr":"10.20.193.105:6821/3597166844","state":["exists","up"]},{"osd":8,"uuid":"fdfc8889-7eda-48ef-ae9d-5ec9cb798a56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6816","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6817","nonce":711294156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6818","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6819","nonce":711294156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6822","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6823","nonce":711294156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6820","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6821","nonce":711294156}]},"public_addr":"10.20.193.175:6817/711294156","cluster_addr":"10.20.193.175:6819/711294156","heartbeat_back_addr":"10.20.193.175:6823/711294156","heartbeat_front_addr":"10.20.193.175:6821/711294156","state":["exists","up"]},{"osd":9,"uuid":"bfa36c36-03aa-4363-85f7-b4cd9450b612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6827","nonce":72013082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6829","nonce":72013082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6833","nonce":72013082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6831","nonce":72013082}]},"public_addr":"10.20.193.90:6827/72013082","cluster_addr":"10.20.193.90:6829/72013082","heartbeat_back_addr":"10.20.193.90:6833/72013082","heartbeat_front_addr":"10.20.193.90:6831/72013082","state":["exists","up"]},{"osd":10,"uuid":"43e47e1a-7160-446c-8fe3-8a20cc2a4c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6824","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6825","nonce":3923796147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6826","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6827","nonce":3923796147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6830","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6831","nonce":3923796147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6828","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6829","nonce":3923796147}]},"public_addr":"10.20.193.105:6825/3923796147","cluster_addr":"10.20.193.105:6827/3923796147","heartbeat_back_addr":"10.20.193.105:6831/3923796147","heartbeat_front_addr":"10.20.193.105:6829/3923796147","state":["exists","up"]},{"osd":11,"uuid":"b789e6a7-be92-4cae-a3a0-d6eebe9b8629","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6824","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6825","nonce":3785438366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6826","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6827","nonce":3785438366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6830","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6831","nonce":3785438366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6828","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6829","nonce":3785438366}]},"public_addr":"10.20.193.175:6825/3785438366","cluster_addr":"10.20.193.175:6827/3785438366","heartbeat_back_addr":"10.20.193.175:6831/3785438366","heartbeat_front_addr":"10.20.193.175:6829/3785438366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:02:53.889642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:00.781533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:08.187332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:15.317071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:22.497099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:29.848931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:37.269086+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:44.452146+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:51.824076+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:59.325996+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:06.588398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:14.010218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/1864372684":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6800/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1997858222":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/66846304":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6801/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6800/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/2504907435":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6801/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1301435029":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/4201652812":"2026-02-20T21:02:09.876469+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T21:04:32.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdac00b5650 msgr2=0x7fdac00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdac00b5650 0x7fdac00d5b00 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdad4004750 tx=0x7fdad4005f10 comp rx=0 tx=0).stop 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 msgr2=0x7fdae411d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae411d730 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdad8005dc0 tx=0x7fdad800bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 shutdown_connections 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdac00b5650 0x7fdac00d5b00 unknown :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdae4122af0 0x7fdae4122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdae4115410 0x7fdae411d730 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 --2- 10.20.193.90:0/2376959496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdae410f200 0x7fdae411d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 >> 10.20.193.90:0/2376959496 conn(0x7fdae40eca60 msgr2=0x7fdae410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 shutdown_connections 2026-02-19T21:04:32.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.482+0000 7fdaebd146c0 1 -- 10.20.193.90:0/2376959496 wait complete. 2026-02-19T21:04:32.522 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-19T21:04:32.646 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:32.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 -- 10.20.193.90:0/3041087580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644115410 msgr2=0x7f3644175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/3041087580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644115410 0x7f3644175db0 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=17201877976620391601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f364000aa70 tx=0x7f364002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 -- 10.20.193.90:0/3041087580 shutdown_connections 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/3041087580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644115410 0x7f3644175db0 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=17201877976620391601 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/3041087580 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f364410fbf0 0x7f3644114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/3041087580 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f364410f200 0x7f364410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 -- 10.20.193.90:0/3041087580 >> 10.20.193.90:0/3041087580 conn(0x7f36440eca60 msgr2=0x7f364410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 -- 10.20.193.90:0/3041087580 shutdown_connections 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.765+0000 7f364c3c96c0 1 -- 10.20.193.90:0/3041087580 wait complete. 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 Processor -- start 2026-02-19T21:04:32.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 -- start start 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f364410f200 0x7f36440666f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3644115410 0x7f3644062950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 0x7f36440633d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3644167ab0 con 0x7f3644062f30 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3644167c20 con 0x7f364410f200 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3644167de0 con 0x7f3644115410 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 0x7f36440633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 0x7f36440633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34056/0 (socket says 10.20.193.90:34056) 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 -- 10.20.193.90:0/901892950 learned_addr learned my addr 10.20.193.90:0/901892950 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f36499396c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3644115410 0x7f3644062950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a13a6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f364410f200 0x7f36440666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 -- 10.20.193.90:0/901892950 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3644115410 msgr2=0x7f3644062950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3644115410 0x7f3644062950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 -- 10.20.193.90:0/901892950 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f364410f200 msgr2=0x7f36440666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f364410f200 0x7f36440666f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 -- 10.20.193.90:0/901892950 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364000a660 con 0x7f3644062f30 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364a93b6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 0x7f36440633d0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3640006ec0 tx=0x7f3640005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3640003c40 con 0x7f3644062f30 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3640005780 con 0x7f3644062f30 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3644168060 con 0x7f3644062f30 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f36400382f0 con 0x7f3644062f30 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.766+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36441684e0 con 0x7f3644062f30 2026-02-19T21:04:32.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.767+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36441104d0 con 0x7f3644062f30 2026-02-19T21:04:32.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.768+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f3640008260 con 0x7f3644062f30 2026-02-19T21:04:32.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.768+0000 7f362b7fe6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f36200b56d0 0x7f36200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:32.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.769+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f3640108dc0 con 0x7f3644062f30 2026-02-19T21:04:32.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.769+0000 7f364a13a6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f36200b56d0 0x7f36200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:32.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.769+0000 7f364a13a6c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f36200b56d0 0x7f36200d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3634005980 tx=0x7f3634005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:32.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.769+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f36400cb8b0 con 0x7f3644062f30 2026-02-19T21:04:32.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:32.884+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f364410fbf0 con 0x7f3644062f30 2026-02-19T21:04:32.887 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:32 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1836953804' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-19T21:04:32.887 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:32 trial090 ceph-mon[31759]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-19T21:04:32.887 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:32 trial090 ceph-mon[31759]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-19T21:04:32.887 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:32 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3522499172' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:32.887 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:32 trial090 ceph-mon[31759]: osdmap e75: 12 total, 12 up, 12 in 2026-02-19T21:04:32.887 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:32 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2376959496' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:32 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1836953804' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-19T21:04:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:32 trial175 ceph-mon[34116]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-19T21:04:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:32 trial175 ceph-mon[34116]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-19T21:04:33.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:32 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3522499172' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:33.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:32 trial175 ceph-mon[34116]: osdmap e75: 12 total, 12 up, 12 in 2026-02-19T21:04:33.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:32 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2376959496' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1836953804' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-19T21:04:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:32 trial105 ceph-mon[33883]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-19T21:04:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:32 trial105 ceph-mon[33883]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-19T21:04:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3522499172' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:32 trial105 ceph-mon[33883]: osdmap e75: 12 total, 12 up, 12 in 2026-02-19T21:04:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2376959496' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.744+0000 7f362b7fe6c0 1 -- 10.20.193.90:0/901892950 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f36400cea60 con 0x7f3644062f30 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f36200b56d0 msgr2=0x7f36200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f36200b56d0 0x7f36200d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3634005980 tx=0x7f3634005910 comp rx=0 tx=0).stop 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 msgr2=0x7f36440633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 0x7f36440633d0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3640006ec0 tx=0x7f3640005520 comp rx=0 tx=0).stop 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 shutdown_connections 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f36200b56d0 0x7f36200d5b80 unknown :-1 s=CLOSED pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:33.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3644062f30 0x7f36440633d0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:33.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3644115410 0x7f3644062950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:33.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 --2- 10.20.193.90:0/901892950 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f364410f200 0x7f36440666f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:33.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 >> 10.20.193.90:0/901892950 conn(0x7f36440eca60 msgr2=0x7f364410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:33.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 shutdown_connections 2026-02-19T21:04:33.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:33.746+0000 7f364c3c96c0 1 -- 10.20.193.90:0/901892950 wait complete. 2026-02-19T21:04:33.785 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2026-02-19T21:04:33.786 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs set cephfs max_mds 3 --yes-i-really-mean-it 2026-02-19T21:04:33.908 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:34.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:33 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.105:6838/25964077,v1:10.20.193.105:6839/25964077] up:active 2026-02-19T21:04:34.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:33 trial175 ceph-mon[34116]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:33 trial175 ceph-mon[34116]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:33 trial175 ceph-mon[34116]: pgmap v176: 97 pgs: 34 active+clean, 28 creating+peering, 35 unknown; 577 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:34.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:33 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/901892950' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-19T21:04:34.021 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:33 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.105:6838/25964077,v1:10.20.193.105:6839/25964077] up:active 2026-02-19T21:04:34.021 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:33 trial090 ceph-mon[31759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.022 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:33 trial090 ceph-mon[31759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.022 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:33 trial090 ceph-mon[31759]: pgmap v176: 97 pgs: 34 active+clean, 28 creating+peering, 35 unknown; 577 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:34.022 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:33 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/901892950' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 -- 10.20.193.90:0/4079347906 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 msgr2=0x7f5eec175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/4079347906 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec175db0 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=12064391498304339012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ee000aa70 tx=0x7f5ee002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 -- 10.20.193.90:0/4079347906 shutdown_connections 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/4079347906 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec175db0 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=12064391498304339012 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/4079347906 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eec10fbf0 0x7f5eec114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/4079347906 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eec10f200 0x7f5eec10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 -- 10.20.193.90:0/4079347906 >> 10.20.193.90:0/4079347906 conn(0x7f5eec0ecac0 msgr2=0x7f5eec10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:34.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 -- 10.20.193.90:0/4079347906 shutdown_connections 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.024+0000 7f5ef28706c0 1 -- 10.20.193.90:0/4079347906 wait complete. 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 Processor -- start 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 -- start start 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eec10f200 0x7f5eec11b370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec11b8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eec120c70 0x7f5eec121110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec121680 con 0x7f5eec115410 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec1217f0 con 0x7f5eec120c70 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec1219b0 con 0x7f5eec10f200 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec11b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:34.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec11b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43298/0 (socket says 10.20.193.90:43298) 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 -- 10.20.193.90:0/2749401008 learned_addr learned my addr 10.20.193.90:0/2749401008 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef0de26c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eec120c70 0x7f5eec121110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eebfff6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eec10f200 0x7f5eec11b370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 -- 10.20.193.90:0/2749401008 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eec10f200 msgr2=0x7f5eec11b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eec10f200 0x7f5eec11b370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 -- 10.20.193.90:0/2749401008 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eec120c70 msgr2=0x7f5eec121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eec120c70 0x7f5eec121110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 -- 10.20.193.90:0/2749401008 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee000a660 con 0x7f5eec115410 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5eeb7fe6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec11b8b0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5edc005dc0 tx=0x7f5edc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5edc004250 con 0x7f5eec115410 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5edc009070 con 0x7f5eec115410 2026-02-19T21:04:34.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec161e60 con 0x7f5eec115410 2026-02-19T21:04:34.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.025+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5edc00cd50 con 0x7f5eec115410 2026-02-19T21:04:34.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.026+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec162340 con 0x7f5eec115410 2026-02-19T21:04:34.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.026+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec1104d0 con 0x7f5eec115410 2026-02-19T21:04:34.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.027+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f5edc0028c0 con 0x7f5eec115410 2026-02-19T21:04:34.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.028+0000 7f5ee97fa6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5ec00b56d0 0x7f5ec00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:34.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.028+0000 7f5eebfff6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5ec00b56d0 0x7f5ec00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:34.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.028+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5edc0e3ac0 con 0x7f5eec115410 2026-02-19T21:04:34.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.028+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5edc0a6570 con 0x7f5eec115410 2026-02-19T21:04:34.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.028+0000 7f5eebfff6c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5ec00b56d0 0x7f5ec00d5b80 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed8005980 tx=0x7f5ed8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:34.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.142+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} v 0) -- 0x7f5eec10fbf0 con 0x7f5eec115410 2026-02-19T21:04:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:33 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.105:6838/25964077,v1:10.20.193.105:6839/25964077] up:active 2026-02-19T21:04:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:33 trial105 ceph-mon[33883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:33 trial105 ceph-mon[33883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:33 trial105 ceph-mon[33883]: pgmap v176: 97 pgs: 34 active+clean, 28 creating+peering, 35 unknown; 577 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-19T21:04:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:33 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/901892950' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-19T21:04:34.713 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.711+0000 7f5ee97fa6c0 1 -- 10.20.193.90:0/2749401008 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]=0 v15) ==== 135+0+0 (secure 0 0 0) 0x7f5edc0a9720 con 0x7f5eec115410 2026-02-19T21:04:34.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.713+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5ec00b56d0 msgr2=0x7f5ec00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.713+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5ec00b56d0 0x7f5ec00d5b80 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ed8005980 tx=0x7f5ed8005910 comp rx=0 tx=0).stop 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.713+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 msgr2=0x7f5eec11b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.713+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec11b8b0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5edc005dc0 tx=0x7f5edc00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 shutdown_connections 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5ec00b56d0 0x7f5ec00d5b80 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eec120c70 0x7f5eec121110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eec115410 0x7f5eec11b8b0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 --2- 10.20.193.90:0/2749401008 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eec10f200 0x7f5eec11b370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 >> 10.20.193.90:0/2749401008 conn(0x7f5eec0ecac0 msgr2=0x7f5eec10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:34.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 shutdown_connections 2026-02-19T21:04:34.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.714+0000 7f5ef28706c0 1 -- 10.20.193.90:0/2749401008 wait complete. 2026-02-19T21:04:34.757 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-19T21:04:34.879 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:34.992 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/901892950' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2749401008' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2749401008' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-19T21:04:34.993 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:34 trial090 ceph-mon[31759]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-19T21:04:34.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/1286731276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8115410 msgr2=0x7fc4a8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:34.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/1286731276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8115410 0x7fc4a8175db0 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=5516564598343104348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc49c00aa70 tx=0x7fc49c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:34.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/1286731276 shutdown_connections 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/1286731276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8115410 0x7fc4a8175db0 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=5516564598343104348 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/1286731276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc4a810fbf0 0x7fc4a8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/1286731276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a810f200 0x7fc4a810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/1286731276 >> 10.20.193.90:0/1286731276 conn(0x7fc4a80eca60 msgr2=0x7fc4a810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/1286731276 shutdown_connections 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.995+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/1286731276 wait complete. 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 Processor -- start 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 -- start start 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc4a810f200 0x7fc4a811d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a8115410 0x7fc4a811d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:35.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 0x7fc4a8122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a81234d0 con 0x7fc4a8122ac0 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8123640 con 0x7fc4a8115410 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8123800 con 0x7fc4a810f200 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 0x7fc4a8122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 0x7fc4a8122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43318/0 (socket says 10.20.193.90:43318) 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 -- 10.20.193.90:0/2890332241 learned_addr learned my addr 10.20.193.90:0/2890332241 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4a77fe6c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a8115410 0x7fc4a811d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4a7fff6c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc4a810f200 0x7fc4a811d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 -- 10.20.193.90:0/2890332241 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc4a810f200 msgr2=0x7fc4a811d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc4a810f200 0x7fc4a811d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 -- 10.20.193.90:0/2890332241 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a8115410 msgr2=0x7fc4a811d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a8115410 0x7fc4a811d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 -- 10.20.193.90:0/2890332241 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c00a660 con 0x7fc4a8122ac0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4a77fe6c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a8115410 0x7fc4a811d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4acc796c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 0x7fc4a8122f60 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc49c0054b0 tx=0x7fc49c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc49c003a30 con 0x7fc4a8122ac0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc49c003b90 con 0x7fc4a8122ac0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a8163c50 con 0x7fc4a8122ac0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc49c0382f0 con 0x7fc4a8122ac0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.996+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a8164080 con 0x7fc4a8122ac0 2026-02-19T21:04:35.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.997+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a81104d0 con 0x7fc4a8122ac0 2026-02-19T21:04:35.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.998+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fc49c008260 con 0x7fc4a8122ac0 2026-02-19T21:04:35.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.999+0000 7fc4a57fa6c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc47c0b5650 0x7fc47c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:35.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.999+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fc49c108ef0 con 0x7fc4a8122ac0 2026-02-19T21:04:35.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.999+0000 7fc4a7fff6c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc47c0b5650 0x7fc47c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:35.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.999+0000 7fc4a7fff6c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc47c0b5650 0x7fc47c0d5b00 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc494005980 tx=0x7fc494005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:35.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:34.999+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc49c0cb9e0 con 0x7fc4a8122ac0 2026-02-19T21:04:35.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/901892950' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-19T21:04:35.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:35.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2749401008' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:04:35.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-19T21:04:35.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-19T21:04:35.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2749401008' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-19T21:04:35.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-19T21:04:35.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:34 trial175 ceph-mon[34116]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-19T21:04:35.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.115+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fc4a810f5d0 con 0x7fc4a8122ac0 2026-02-19T21:04:35.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/901892950' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-19T21:04:35.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-19T21:04:35.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2749401008' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true} : dispatch 2026-02-19T21:04:35.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-19T21:04:35.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-19T21:04:35.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2749401008' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3", "yes_i_really_mean_it": true}]': finished 2026-02-19T21:04:35.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-19T21:04:35.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:34 trial105 ceph-mon[33883]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-19T21:04:35.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.713+0000 7fc4a57fa6c0 1 -- 10.20.193.90:0/2890332241 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7fc49c0ceb90 con 0x7fc4a8122ac0 2026-02-19T21:04:35.719 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.717+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc47c0b5650 msgr2=0x7fc47c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.717+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc47c0b5650 0x7fc47c0d5b00 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc494005980 tx=0x7fc494005910 comp rx=0 tx=0).stop 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.717+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 msgr2=0x7fc4a8122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.717+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 0x7fc4a8122f60 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc49c0054b0 tx=0x7fc49c0054e0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 shutdown_connections 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc47c0b5650 0x7fc47c0d5b00 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc4a8122ac0 0x7fc4a8122f60 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc4a8115410 0x7fc4a811d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 --2- 10.20.193.90:0/2890332241 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc4a810f200 0x7fc4a811d1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 >> 10.20.193.90:0/2890332241 conn(0x7fc4a80eca60 msgr2=0x7fc4a810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:35.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 shutdown_connections 2026-02-19T21:04:35.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:35.718+0000 7fc4ae7076c0 1 -- 10.20.193.90:0/2890332241 wait complete. 2026-02-19T21:04:35.759 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-19T21:04:35.883 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: pgmap v177: 97 pgs: 72 active+clean, 25 creating+peering; 578 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 6 op/s 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2890332241' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2890332241' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.105:6836/2484410627,v1:10.20.193.105:6837/2484410627] up:active 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-19T21:04:35.997 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:35 trial090 ceph-mon[31759]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-19T21:04:36.005 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- 10.20.193.90:0/199783501 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 msgr2=0x7f98a810d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- 10.20.193.90:0/199783501 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a810d340 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=3816753410055851755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98940099a0 tx=0x7f989402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- 10.20.193.90:0/199783501 shutdown_connections 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- 10.20.193.90:0/199783501 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f98a8113180 0x7f98a8173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- 10.20.193.90:0/199783501 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f98a810d960 0x7f98a81129a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- 10.20.193.90:0/199783501 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a810d340 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=3816753410055851755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- 10.20.193.90:0/199783501 >> 10.20.193.90:0/199783501 conn(0x7f98a80ea870 msgr2=0x7f98a810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- 10.20.193.90:0/199783501 shutdown_connections 2026-02-19T21:04:36.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- 10.20.193.90:0/199783501 wait complete. 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 Processor -- start 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- start start 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a811b060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f98a8113180 0x7f98a811b5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f98a8120960 0x7f98a8120e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98a8121370 con 0x7f98a810cf70 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f98a81214e0 con 0x7f98a8113180 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.002+0000 7f98aea386c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f98a81216a0 con 0x7f98a8120960 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a811b060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a811b060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43338/0 (socket says 10.20.193.90:43338) 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 -- 10.20.193.90:0/2429117763 learned_addr learned my addr 10.20.193.90:0/2429117763 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:36.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98acfaa6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f98a8120960 0x7f98a8120e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a77fe6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f98a8113180 0x7f98a811b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 -- 10.20.193.90:0/2429117763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f98a8120960 msgr2=0x7f98a8120e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f98a8120960 0x7f98a8120e00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 -- 10.20.193.90:0/2429117763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f98a8113180 msgr2=0x7f98a811b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f98a8113180 0x7f98a811b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 -- 10.20.193.90:0/2429117763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9894009590 con 0x7f98a810cf70 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a7fff6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a811b060 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f989402f230 tx=0x7f989402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9894002ba0 con 0x7f98a810cf70 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a8161af0 con 0x7f98a810cf70 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9894002d00 con 0x7f98a810cf70 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f98940372f0 con 0x7f98a810cf70 2026-02-19T21:04:36.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a8161f20 con 0x7f98a810cf70 2026-02-19T21:04:36.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.003+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a810e240 con 0x7f98a810cf70 2026-02-19T21:04:36.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.005+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f98940078d0 con 0x7f98a810cf70 2026-02-19T21:04:36.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.006+0000 7f98a57fa6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f987c0b5650 0x7f987c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:36.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.006+0000 7f98a77fe6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f987c0b5650 0x7f987c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:36.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.006+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f9894107af0 con 0x7f98a810cf70 2026-02-19T21:04:36.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.006+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f98941405e0 con 0x7f98a810cf70 2026-02-19T21:04:36.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.006+0000 7f98a77fe6c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f987c0b5650 0x7f987c0d5b00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98a81219f0 tx=0x7f9898009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:36.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: pgmap v177: 97 pgs: 72 active+clean, 25 creating+peering; 578 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 6 op/s 2026-02-19T21:04:36.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2890332241' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-19T21:04:36.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2890332241' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-19T21:04:36.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.105:6836/2484410627,v1:10.20.193.105:6837/2484410627] up:active 2026-02-19T21:04:36.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-19T21:04:36.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-19T21:04:36.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-19T21:04:36.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-19T21:04:36.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:35 trial175 ceph-mon[34116]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-19T21:04:36.121 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.119+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f98a810d960 con 0x7f98a810cf70 2026-02-19T21:04:36.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: pgmap v177: 97 pgs: 72 active+clean, 25 creating+peering; 578 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 6 op/s 2026-02-19T21:04:36.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2890332241' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2890332241' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.105:6836/2484410627,v1:10.20.193.105:6837/2484410627] up:active 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2026-02-19T21:04:36.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:35 trial105 ceph-mon[33883]: daemon mds.i is now active in filesystem cephfs as rank 2 2026-02-19T21:04:36.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.719+0000 7f98a57fa6c0 1 -- 10.20.193.90:0/2429117763 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f98940ca5a0 con 0x7f98a810cf70 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f987c0b5650 msgr2=0x7f987c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f987c0b5650 0x7f987c0d5b00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f98a81219f0 tx=0x7f9898009390 comp rx=0 tx=0).stop 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 msgr2=0x7f98a811b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a811b060 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f989402f230 tx=0x7f989402fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 shutdown_connections 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f987c0b5650 0x7f987c0d5b00 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f98a8120960 0x7f98a8120e00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f98a8113180 0x7f98a811b5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 --2- 10.20.193.90:0/2429117763 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f98a810cf70 0x7f98a811b060 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:36.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 >> 10.20.193.90:0/2429117763 conn(0x7f98a80ea870 msgr2=0x7f98a810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:36.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 shutdown_connections 2026-02-19T21:04:36.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:36.721+0000 7f98aea386c0 1 -- 10.20.193.90:0/2429117763 wait complete. 2026-02-19T21:04:36.763 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2026-02-19T21:04:36.763 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-19T21:04:36.887 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:37.000 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:36 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2429117763' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-19T21:04:37.000 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:36 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2429117763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-19T21:04:37.000 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:36 trial090 ceph-mon[31759]: mds.? [v2:10.20.193.175:6838/1534233526,v1:10.20.193.175:6839/1534233526] up:active 2026-02-19T21:04:37.001 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:36 trial090 ceph-mon[31759]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-19T21:04:37.001 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:36 trial090 ceph-mon[31759]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-19T21:04:37.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- 10.20.193.90:0/1743584844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 msgr2=0x7f4034175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/1743584844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f4034175db0 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=13085932608688764728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f402400aa70 tx=0x7f402402fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- 10.20.193.90:0/1743584844 shutdown_connections 2026-02-19T21:04:37.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/1743584844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f4034175db0 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=13085932608688764728 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/1743584844 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f403410fbf0 0x7f4034114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.006 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/1743584844 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f403410f200 0x7f403410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- 10.20.193.90:0/1743584844 >> 10.20.193.90:0/1743584844 conn(0x7f40340ecac0 msgr2=0x7f403410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- 10.20.193.90:0/1743584844 shutdown_connections 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- 10.20.193.90:0/1743584844 wait complete. 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 Processor -- start 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- start start 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f403410f200 0x7f403411d2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f403411d7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4034122ba0 0x7f4034123040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f40341235b0 con 0x7f4034115410 2026-02-19T21:04:37.007 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4034123720 con 0x7f403410f200 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4038ac06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f40341238e0 con 0x7f4034122ba0 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4031d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f403411d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4031d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f403411d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43360/0 (socket says 10.20.193.90:43360) 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4031d746c0 1 -- 10.20.193.90:0/3201719699 learned_addr learned my addr 10.20.193.90:0/3201719699 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f4032d766c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4034122ba0 0x7f4034123040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.002+0000 7f40325756c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f403410f200 0x7f403411d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4031d746c0 1 -- 10.20.193.90:0/3201719699 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4034122ba0 msgr2=0x7f4034123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4031d746c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4034122ba0 0x7f4034123040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4031d746c0 1 -- 10.20.193.90:0/3201719699 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f403410f200 msgr2=0x7f403411d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4031d746c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f403410f200 0x7f403411d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.008 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4031d746c0 1 -- 10.20.193.90:0/3201719699 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f402400a660 con 0x7f4034115410 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4031d746c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f403411d7e0 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f401c005dc0 tx=0x7f401c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f401c004250 con 0x7f4034115410 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f401c009070 con 0x7f4034115410 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4034163d90 con 0x7f4034115410 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f401c00cd50 con 0x7f4034115410 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4034164270 con 0x7f4034115410 2026-02-19T21:04:37.009 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.003+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40341104d0 con 0x7f4034115410 2026-02-19T21:04:37.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.005+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f401c0028c0 con 0x7f4034115410 2026-02-19T21:04:37.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.005+0000 7f401b7fe6c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f400c0b56d0 0x7f400c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.005+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f401c0e39e0 con 0x7f4034115410 2026-02-19T21:04:37.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.005+0000 7f40325756c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f400c0b56d0 0x7f400c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.006+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f401c11c5e0 con 0x7f4034115410 2026-02-19T21:04:37.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.006+0000 7f40325756c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f400c0b56d0 0x7f400c0d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4028005980 tx=0x7f40280094b0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:37.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:36 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2429117763' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-19T21:04:37.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:36 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2429117763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-19T21:04:37.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:36 trial175 ceph-mon[34116]: mds.? [v2:10.20.193.175:6838/1534233526,v1:10.20.193.175:6839/1534233526] up:active 2026-02-19T21:04:37.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:36 trial175 ceph-mon[34116]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-19T21:04:37.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:36 trial175 ceph-mon[34116]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-19T21:04:37.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.114+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f403411e480 con 0x7f400c0b56d0 2026-02-19T21:04:37.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.129+0000 7f401b7fe6c0 1 -- 10.20.193.90:0/3201719699 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4028009020 con 0x7f400c0b56d0 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f400c0b56d0 msgr2=0x7f400c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f400c0b56d0 0x7f400c0d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4028005980 tx=0x7f40280094b0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 msgr2=0x7f403411d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f403411d7e0 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f401c005dc0 tx=0x7f401c00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 shutdown_connections 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f400c0b56d0 0x7f400c0d5b80 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4034122ba0 0x7f4034123040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4034115410 0x7f403411d7e0 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 --2- 10.20.193.90:0/3201719699 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f403410f200 0x7f403411d2a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 >> 10.20.193.90:0/3201719699 conn(0x7f40340ecac0 msgr2=0x7f403410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:37.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 shutdown_connections 2026-02-19T21:04:37.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.131+0000 7f4038ac06c0 1 -- 10.20.193.90:0/3201719699 wait complete. 2026-02-19T21:04:37.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2429117763' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-19T21:04:37.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2429117763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-19T21:04:37.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-mon[33883]: mds.? [v2:10.20.193.175:6838/1534233526,v1:10.20.193.175:6839/1534233526] up:active 2026-02-19T21:04:37.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-mon[33883]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2026-02-19T21:04:37.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-mon[33883]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2026-02-19T21:04:37.146 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-b[63509]: 2026-02-19T21:04:36.729+0000 7fc7af7786c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-19T21:04:37.146 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-b[63509]: 2026-02-19T21:04:36.729+0000 7fc7af7786c0 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-19T21:04:37.146 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:04:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-b[63509]: 2026-02-19T21:04:36.729+0000 7fc7af7786c0 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2026-02-19T21:04:37.169 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-19T21:04:37.293 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:37.313 INFO:journalctl@ceph.mgr.x.trial090.stdout:Feb 19 21:04:37 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mgr-x[32042]: 2026-02-19T21:04:37.119+0000 7fdf56d696c0 -1 client.14874 error registering admin socket command: (17) File exists 2026-02-19T21:04:37.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 -- 10.20.193.90:0/3396412351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f45201149b0 msgr2=0x7f452011d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/3396412351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f45201149b0 0x7f452011d700 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=2610935579995781274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45080099a0 tx=0x7f450802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:37.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 -- 10.20.193.90:0/3396412351 shutdown_connections 2026-02-19T21:04:37.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/3396412351 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f452011dee0 0x7f452017e7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.412 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/3396412351 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f45201149b0 0x7f452011d700 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=2610935579995781274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/3396412351 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4520113fc0 0x7f4520114390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 -- 10.20.193.90:0/3396412351 >> 10.20.193.90:0/3396412351 conn(0x7f452005c850 msgr2=0x7f4520058b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 -- 10.20.193.90:0/3396412351 shutdown_connections 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.408+0000 7f4524ab06c0 1 -- 10.20.193.90:0/3396412351 wait complete. 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 Processor -- start 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 -- start start 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4520113fc0 0x7f4520125e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 0x7f4520126370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f452012b6e0 0x7f452012bb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f452012c0f0 con 0x7f452011dee0 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f452012c260 con 0x7f4520113fc0 2026-02-19T21:04:37.413 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f452012c420 con 0x7f452012b6e0 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 0x7f4520126370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 0x7f4520126370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43378/0 (socket says 10.20.193.90:43378) 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 -- 10.20.193.90:0/967367191 learned_addr learned my addr 10.20.193.90:0/967367191 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 -- 10.20.193.90:0/967367191 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f452012b6e0 msgr2=0x7f452012bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f452012b6e0 0x7f452012bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 -- 10.20.193.90:0/967367191 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4520113fc0 msgr2=0x7f4520125e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4520113fc0 0x7f4520125e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 -- 10.20.193.90:0/967367191 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4508009590 con 0x7f452011dee0 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f451dd746c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 0x7f4520126370 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45080023c0 tx=0x7f450802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4508002ae0 con 0x7f452011dee0 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4508002c40 con 0x7f452011dee0 2026-02-19T21:04:37.414 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452016c870 con 0x7f452011dee0 2026-02-19T21:04:37.415 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45080372f0 con 0x7f452011dee0 2026-02-19T21:04:37.415 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.409+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452016ccf0 con 0x7f452011dee0 2026-02-19T21:04:37.415 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.410+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45200565d0 con 0x7f452011dee0 2026-02-19T21:04:37.416 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.411+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f4508007810 con 0x7f452011dee0 2026-02-19T21:04:37.416 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.411+0000 7f45077fe6c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44f80b56d0 0x7f44f80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.416 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.411+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f4508107c20 con 0x7f452011dee0 2026-02-19T21:04:37.416 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.411+0000 7f451e5756c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44f80b56d0 0x7f44f80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.416 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.412+0000 7f451e5756c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44f80b56d0 0x7f44f80d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4514005980 tx=0x7f4514005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:37.416 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.412+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f45080ca710 con 0x7f452011dee0 2026-02-19T21:04:37.523 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.521+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f45201149b0 con 0x7f44f80b56d0 2026-02-19T21:04:37.536 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.534+0000 7f45077fe6c0 1 -- 10.20.193.90:0/967367191 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f45201149b0 con 0x7f44f80b56d0 2026-02-19T21:04:37.537 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44f80b56d0 msgr2=0x7f44f80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44f80b56d0 0x7f44f80d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4514005980 tx=0x7f4514005910 comp rx=0 tx=0).stop 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 msgr2=0x7f4520126370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 0x7f4520126370 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45080023c0 tx=0x7f450802fbf0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 shutdown_connections 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44f80b56d0 0x7f44f80d5b80 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f452012b6e0 0x7f452012bb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f452011dee0 0x7f4520126370 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 --2- 10.20.193.90:0/967367191 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4520113fc0 0x7f4520125e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 >> 10.20.193.90:0/967367191 conn(0x7f452005c850 msgr2=0x7f452011b900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:37.538 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 shutdown_connections 2026-02-19T21:04:37.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.535+0000 7f4524ab06c0 1 -- 10.20.193.90:0/967367191 wait complete. 2026-02-19T21:04:37.576 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-19T21:04:37.697 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:37.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- 10.20.193.90:0/3051804139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f223810fbf0 msgr2=0x7f2238114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- 10.20.193.90:0/3051804139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f223810fbf0 0x7f2238114c30 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=9421731179732016298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22200099a0 tx=0x7f222002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:37.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- 10.20.193.90:0/3051804139 shutdown_connections 2026-02-19T21:04:37.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- 10.20.193.90:0/3051804139 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2238115410 0x7f2238175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- 10.20.193.90:0/3051804139 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f223810fbf0 0x7f2238114c30 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=9421731179732016298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- 10.20.193.90:0/3051804139 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f223810f200 0x7f223810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- 10.20.193.90:0/3051804139 >> 10.20.193.90:0/3051804139 conn(0x7f22380ecac0 msgr2=0x7f223810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:37.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- 10.20.193.90:0/3051804139 shutdown_connections 2026-02-19T21:04:37.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- 10.20.193.90:0/3051804139 wait complete. 2026-02-19T21:04:37.820 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:37 trial090 ceph-mon[31759]: pgmap v178: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 10 op/s 2026-02-19T21:04:37.820 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:37 trial090 ceph-mon[31759]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:37.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 Processor -- start 2026-02-19T21:04:37.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- start start 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f223810f200 0x7f22380f4cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2238115410 0x7f2238175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 0x7f22380fa5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22380f5a10 con 0x7f22380f5320 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22380fab30 con 0x7f2238115410 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.817+0000 7f223d6106c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f22380facf0 con 0x7f223810f200 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 0x7f22380fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 0x7f22380fa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43388/0 (socket says 10.20.193.90:43388) 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22367fc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2238115410 0x7f2238175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 -- 10.20.193.90:0/2558939452 learned_addr learned my addr 10.20.193.90:0/2558939452 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f2236ffd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f223810f200 0x7f22380f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 -- 10.20.193.90:0/2558939452 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f223810f200 msgr2=0x7f22380f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f223810f200 0x7f22380f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 -- 10.20.193.90:0/2558939452 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2238115410 msgr2=0x7f2238175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2238115410 0x7f2238175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 -- 10.20.193.90:0/2558939452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2220009590 con 0x7f22380f5320 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22367fc6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2238115410 0x7f2238175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f22377fe6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 0x7f22380fa5f0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2228006ea0 tx=0x7f222800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2228003a30 con 0x7f22380f5320 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22380fafd0 con 0x7f22380f5320 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f22280054f0 con 0x7f22380f5320 2026-02-19T21:04:37.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22380fb760 con 0x7f22380f5320 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f222800dc30 con 0x7f22380f5320 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.818+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22381104d0 con 0x7f22380f5320 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.820+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f2228005030 con 0x7f22380f5320 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.820+0000 7f2217fff6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f220c0b56d0 0x7f220c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.820+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f22280e4a00 con 0x7f22380f5320 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.820+0000 7f2236ffd6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f220c0b56d0 0x7f220c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.820+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22280a74b0 con 0x7f22380f5320 2026-02-19T21:04:37.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.821+0000 7f2236ffd6c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f220c0b56d0 0x7f220c0d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f222c004750 tx=0x7f222c009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:37.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.928+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f22380f5e40 con 0x7f220c0b56d0 2026-02-19T21:04:37.933 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.931+0000 7f2217fff6c0 1 -- 10.20.193.90:0/2558939452 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f22380f5e40 con 0x7f220c0b56d0 2026-02-19T21:04:37.933 INFO:teuthology.orchestra.run.trial090.stdout:/volumes/qa/sv_0/41809f5f-5ace-4489-95ef-924a198b8fc7 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.932+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f220c0b56d0 msgr2=0x7f220c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.932+0000 7f223d6106c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f220c0b56d0 0x7f220c0d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f222c004750 tx=0x7f222c009390 comp rx=0 tx=0).stop 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.932+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 msgr2=0x7f22380fa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.932+0000 7f223d6106c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 0x7f22380fa5f0 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2228006ea0 tx=0x7f222800cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 shutdown_connections 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f220c0b56d0 0x7f220c0d5b80 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.934 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f22380f5320 0x7f22380fa5f0 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2238115410 0x7f2238175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 --2- 10.20.193.90:0/2558939452 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f223810f200 0x7f22380f4cf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:37.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 >> 10.20.193.90:0/2558939452 conn(0x7f22380ecac0 msgr2=0x7f223810d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:37.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 shutdown_connections 2026-02-19T21:04:37.935 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:37.933+0000 7f223d6106c0 1 -- 10.20.193.90:0/2558939452 wait complete. 2026-02-19T21:04:37.971 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-19T21:04:38.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:37 trial175 ceph-mon[34116]: pgmap v178: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 10 op/s 2026-02-19T21:04:38.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:37 trial175 ceph-mon[34116]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:38.093 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:38.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:37 trial105 ceph-mon[33883]: pgmap v178: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s wr, 10 op/s 2026-02-19T21:04:38.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:37 trial105 ceph-mon[33883]: from='client.14868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- 10.20.193.90:0/3163583477 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c10f200 msgr2=0x7f852c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- 10.20.193.90:0/3163583477 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c10f200 0x7f852c10f5d0 secure :-1 s=READY pgs=230 gs=1 cs=0 l=1 c_cookie=5566950991302349129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85200099a0 tx=0x7f852002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- 10.20.193.90:0/3163583477 shutdown_connections 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- 10.20.193.90:0/3163583477 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f852c115410 0x7f852c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- 10.20.193.90:0/3163583477 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c10fbf0 0x7f852c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- 10.20.193.90:0/3163583477 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c10f200 0x7f852c10f5d0 unknown :-1 s=CLOSED pgs=230 gs=1 cs=0 l=1 c_cookie=5566950991302349129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- 10.20.193.90:0/3163583477 >> 10.20.193.90:0/3163583477 conn(0x7f852c0ecac0 msgr2=0x7f852c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:38.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- 10.20.193.90:0/3163583477 shutdown_connections 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- 10.20.193.90:0/3163583477 wait complete. 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 Processor -- start 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- start start 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f852c10f200 0x7f852c11d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 0x7f852c11d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c122bf0 0x7f852c123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f852c123600 con 0x7f852c115410 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f852c123770 con 0x7f852c122bf0 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f85313286c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f852c123930 con 0x7f852c10f200 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f852a7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 0x7f852c11d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f852a7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 0x7f852c11d830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43406/0 (socket says 10.20.193.90:43406) 2026-02-19T21:04:38.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.217+0000 7f852a7fc6c0 1 -- 10.20.193.90:0/2947563528 learned_addr learned my addr 10.20.193.90:0/2947563528 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852affd6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f852c10f200 0x7f852c11d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852b7fe6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c122bf0 0x7f852c123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852a7fc6c0 1 -- 10.20.193.90:0/2947563528 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f852c10f200 msgr2=0x7f852c11d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852a7fc6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f852c10f200 0x7f852c11d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852a7fc6c0 1 -- 10.20.193.90:0/2947563528 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c122bf0 msgr2=0x7f852c123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852a7fc6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c122bf0 0x7f852c123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852a7fc6c0 1 -- 10.20.193.90:0/2947563528 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8520009590 con 0x7f852c115410 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852b7fe6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c122bf0 0x7f852c123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f852a7fc6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 0x7f852c11d830 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8514005dc0 tx=0x7f851400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8514004250 con 0x7f852c115410 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8514009070 con 0x7f852c115410 2026-02-19T21:04:38.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f852c163de0 con 0x7f852c115410 2026-02-19T21:04:38.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f851400cd50 con 0x7f852c115410 2026-02-19T21:04:38.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852c1642c0 con 0x7f852c115410 2026-02-19T21:04:38.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.218+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852c1104d0 con 0x7f852c115410 2026-02-19T21:04:38.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.220+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f85140028c0 con 0x7f852c115410 2026-02-19T21:04:38.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.220+0000 7f850bfff6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85000b56d0 0x7f85000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.221+0000 7f852affd6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85000b56d0 0x7f85000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.221+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f85140e3a80 con 0x7f852c115410 2026-02-19T21:04:38.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.221+0000 7f852affd6c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85000b56d0 0x7f85000d5b80 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85200092e0 tx=0x7f8520005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:38.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.221+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f85140a9fd0 con 0x7f852c115410 2026-02-19T21:04:38.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.329+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f852c10fbf0 con 0x7f85000b56d0 2026-02-19T21:04:38.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.344+0000 7f850bfff6c0 1 -- 10.20.193.90:0/2947563528 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f852c10fbf0 con 0x7f85000b56d0 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85000b56d0 msgr2=0x7f85000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85000b56d0 0x7f85000d5b80 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f85200092e0 tx=0x7f8520005c00 comp rx=0 tx=0).stop 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 msgr2=0x7f852c11d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 0x7f852c11d830 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8514005dc0 tx=0x7f851400bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 shutdown_connections 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85000b56d0 0x7f85000d5b80 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f852c122bf0 0x7f852c123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f852c115410 0x7f852c11d830 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 --2- 10.20.193.90:0/2947563528 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f852c10f200 0x7f852c11d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 >> 10.20.193.90:0/2947563528 conn(0x7f852c0ecac0 msgr2=0x7f852c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:38.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 shutdown_connections 2026-02-19T21:04:38.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.345+0000 7f85313286c0 1 -- 10.20.193.90:0/2947563528 wait complete. 2026-02-19T21:04:38.384 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-19T21:04:38.507 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:38.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2735967151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c240606e0 msgr2=0x7f1c24060ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2735967151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c240606e0 0x7f1c24060ab0 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=15671618447444262701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c18009970 tx=0x7f1c1802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:38.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2735967151 shutdown_connections 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2735967151 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c24155690 0x7f1c24175a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2735967151 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c24060ff0 0x7f1c24155150 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2735967151 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c240606e0 0x7f1c24060ab0 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=15671618447444262701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2735967151 >> 10.20.193.90:0/2735967151 conn(0x7f1c240ea840 msgr2=0x7f1c2410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2735967151 shutdown_connections 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2735967151 wait complete. 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 Processor -- start 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.616+0000 7f1c2962c6c0 1 -- start start 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c240606e0 0x7f1c24161550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c24060ff0 0x7f1c24161a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 0x7f1c24166e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241674a0 con 0x7f1c24155690 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1c24167610 con 0x7f1c24060ff0 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c241677d0 con 0x7f1c240606e0 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 0x7f1c24166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 0x7f1c24166e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43424/0 (socket says 10.20.193.90:43424) 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 -- 10.20.193.90:0/2389612846 learned_addr learned my addr 10.20.193.90:0/2389612846 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c227fc6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c24060ff0 0x7f1c24161a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c22ffd6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c240606e0 0x7f1c24161550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 -- 10.20.193.90:0/2389612846 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c240606e0 msgr2=0x7f1c24161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c240606e0 0x7f1c24161550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 -- 10.20.193.90:0/2389612846 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c24060ff0 msgr2=0x7f1c24161a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c24060ff0 0x7f1c24161a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 -- 10.20.193.90:0/2389612846 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c18009590 con 0x7f1c24155690 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c237fe6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 0x7f1c24166e50 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c1400c6c0 tx=0x7f1c1400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c14003c40 con 0x7f1c24155690 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1c1400a030 con 0x7f1c24155690 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c24167ab0 con 0x7f1c24155690 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c1400db70 con 0x7f1c24155690 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c241512c0 con 0x7f1c24155690 2026-02-19T21:04:38.623 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.617+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c24061bf0 con 0x7f1c24155690 2026-02-19T21:04:38.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.619+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f1c1400dd20 con 0x7f1c24155690 2026-02-19T21:04:38.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.619+0000 7f1c03fff6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bf80b5650 0x7f1bf80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:38.624 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.619+0000 7f1c22ffd6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bf80b5650 0x7f1bf80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:38.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.620+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1c140e4890 con 0x7f1c24155690 2026-02-19T21:04:38.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.620+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1c140a7340 con 0x7f1c24155690 2026-02-19T21:04:38.625 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.620+0000 7f1c22ffd6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bf80b5650 0x7f1bf80d5b00 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c180023e0 tx=0x7f1c18005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:38.729 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.728+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1c241626a0 con 0x7f1bf80b5650 2026-02-19T21:04:38.732 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.730+0000 7f1c03fff6c0 1 -- 10.20.193.90:0/2389612846 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1c241626a0 con 0x7f1bf80b5650 2026-02-19T21:04:38.732 INFO:teuthology.orchestra.run.trial090.stdout:/volumes/qa/sv_1/1da8c194-50db-407f-bcbe-a84513e0fd93 2026-02-19T21:04:38.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bf80b5650 msgr2=0x7f1bf80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bf80b5650 0x7f1bf80d5b00 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c180023e0 tx=0x7f1c18005c60 comp rx=0 tx=0).stop 2026-02-19T21:04:38.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 msgr2=0x7f1c24166e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 0x7f1c24166e50 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c1400c6c0 tx=0x7f1c1400cb90 comp rx=0 tx=0).stop 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 shutdown_connections 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1bf80b5650 0x7f1bf80d5b00 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c24155690 0x7f1c24166e50 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c24060ff0 0x7f1c24161a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 --2- 10.20.193.90:0/2389612846 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c240606e0 0x7f1c24161550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 >> 10.20.193.90:0/2389612846 conn(0x7f1c240ea840 msgr2=0x7f1c2410ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 shutdown_connections 2026-02-19T21:04:38.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:38.731+0000 7f1c2962c6c0 1 -- 10.20.193.90:0/2389612846 wait complete. 2026-02-19T21:04:38.770 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph fs dump --format=json 2026-02-19T21:04:38.891 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:38.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:38 trial090 ceph-mon[31759]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:38.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:38 trial090 ceph-mon[31759]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:39.010 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- 10.20.193.90:0/4088316535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c113180 msgr2=0x7f219c173b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/4088316535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c113180 0x7f219c173b20 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=13369929102468206452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f218c00aa70 tx=0x7f218c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- 10.20.193.90:0/4088316535 shutdown_connections 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/4088316535 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c113180 0x7f219c173b20 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=13369929102468206452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/4088316535 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c10d960 0x7f219c1129a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/4088316535 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f219c10cf70 0x7f219c10d340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- 10.20.193.90:0/4088316535 >> 10.20.193.90:0/4088316535 conn(0x7f219c0ea870 msgr2=0x7f219c10ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- 10.20.193.90:0/4088316535 shutdown_connections 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- 10.20.193.90:0/4088316535 wait complete. 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 Processor -- start 2026-02-19T21:04:39.011 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- start start 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 0x7f219c11af50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c113180 0x7f219c11b490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f219c120850 0x7f219c120cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f219c121260 con 0x7f219c10cf70 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1213d0 con 0x7f219c113180 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f21a136c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f219c121590 con 0x7f219c120850 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.007+0000 7f219affd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 0x7f219c11af50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 0x7f219c11af50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43442/0 (socket says 10.20.193.90:43442) 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 -- 10.20.193.90:0/2855889128 learned_addr learned my addr 10.20.193.90:0/2855889128 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219b7fe6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f219c120850 0x7f219c120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.012 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219a7fc6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c113180 0x7f219c11b490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 -- 10.20.193.90:0/2855889128 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f219c120850 msgr2=0x7f219c120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f219c120850 0x7f219c120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 -- 10.20.193.90:0/2855889128 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c113180 msgr2=0x7f219c11b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c113180 0x7f219c11b490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 -- 10.20.193.90:0/2855889128 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c00a660 con 0x7f219c10cf70 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219a7fc6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c113180 0x7f219c11b490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f219affd6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 0x7f219c11af50 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2190005dc0 tx=0x7f219000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2190004250 con 0x7f219c10cf70 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2190009070 con 0x7f219c10cf70 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c161a40 con 0x7f219c10cf70 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f219000cd70 con 0x7f219c10cf70 2026-02-19T21:04:39.013 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c161ed0 con 0x7f219c10cf70 2026-02-19T21:04:39.014 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.008+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c10e240 con 0x7f219c10cf70 2026-02-19T21:04:39.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.010+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7f21900028c0 con 0x7f219c10cf70 2026-02-19T21:04:39.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.010+0000 7f217bfff6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f21700b56d0 0x7f21700d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.010+0000 7f219a7fc6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f21700b56d0 0x7f21700d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.011+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f21900e3a80 con 0x7f219c10cf70 2026-02-19T21:04:39.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.011+0000 7f219a7fc6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f21700b56d0 0x7f21700d5b80 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f219c1218e0 tx=0x7f2184009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:39.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.011+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f219011c5e0 con 0x7f219c10cf70 2026-02-19T21:04:39.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:38 trial175 ceph-mon[34116]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:39.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:38 trial175 ceph-mon[34116]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:39.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.124+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f219c10d960 con 0x7f219c10cf70 2026-02-19T21:04:39.126 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.124+0000 7f217bfff6c0 1 -- 10.20.193.90:0/2855889128 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11943 (secure 0 0 0) 0x7f21900a6570 con 0x7f219c10cf70 2026-02-19T21:04:39.127 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:39.127 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":19,"btime":"2026-02-19T21:04:36:723789+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14733,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6835/2408399270","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6834","nonce":2408399270},{"type":"v1","addr":"10.20.193.90:6835","nonce":2408399270}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14745,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6837/248858987","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6836","nonce":248858987},{"type":"v1","addr":"10.20.193.90:6837","nonce":248858987}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14778,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6839/3725935308","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6838","nonce":3725935308},{"type":"v1","addr":"10.20.193.90:6839","nonce":3725935308}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14790,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.90:6841/2221645903","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6840","nonce":2221645903},{"type":"v1","addr":"10.20.193.90:6841","nonce":2221645903}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24568,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.175:6833/3709156295","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6832","nonce":3709156295},{"type":"v1","addr":"10.20.193.175:6833","nonce":3709156295}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.105:6833/4254586612","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6832","nonce":4254586612},{"type":"v1","addr":"10.20.193.105:6833","nonce":4254586612}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-19T21:04:30.811968+0000","modified":"2026-02-19T21:04:36.723783+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24638,"mds_1":24614,"mds_2":24613},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.175:6835/1761051629","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6834","nonce":1761051629},{"type":"v1","addr":"10.20.193.175:6835","nonce":1761051629}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24599":{"gid":24599,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.105:6835/3619938278","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6834","nonce":3619938278},{"type":"v1","addr":"10.20.193.105:6835","nonce":3619938278}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24601":{"gid":24601,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.175:6837/649777128","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6836","nonce":649777128},{"type":"v1","addr":"10.20.193.175:6837","nonce":649777128}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"i","rank":2,"incarnation":17,"state":"up:active","state_seq":4,"addr":"10.20.193.175:6839/1534233526","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6838","nonce":1534233526},{"type":"v1","addr":"10.20.193.175:6839","nonce":1534233526}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"h","rank":1,"incarnation":15,"state":"up:active","state_seq":4,"addr":"10.20.193.105:6837/2484410627","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6836","nonce":2484410627},{"type":"v1","addr":"10.20.193.105:6837","nonce":2484410627}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.105:6839/25964077","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6838","nonce":25964077},{"type":"v1","addr":"10.20.193.105:6839","nonce":25964077}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24638,"qdb_cluster":[24638,24614,24613]},"id":1}]} 2026-02-19T21:04:39.128 INFO:teuthology.orchestra.run.trial090.stderr:dumped fsmap epoch 19 2026-02-19T21:04:39.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f21700b56d0 msgr2=0x7f21700d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.128 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f21700b56d0 0x7f21700d5b80 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f219c1218e0 tx=0x7f2184009260 comp rx=0 tx=0).stop 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 msgr2=0x7f219c11af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 0x7f219c11af50 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2190005dc0 tx=0x7f219000bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 shutdown_connections 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f21700b56d0 0x7f21700d5b80 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f219c120850 0x7f219c120cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f219c113180 0x7f219c11b490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 --2- 10.20.193.90:0/2855889128 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f219c10cf70 0x7f219c11af50 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 >> 10.20.193.90:0/2855889128 conn(0x7f219c0ea870 msgr2=0x7f219c10ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 shutdown_connections 2026-02-19T21:04:39.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.125+0000 7f21a136c6c0 1 -- 10.20.193.90:0/2855889128 wait complete. 2026-02-19T21:04:39.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:38 trial105 ceph-mon[33883]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:39.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:38 trial105 ceph-mon[33883]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:39.165 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T21:04:39.290 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:39.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/2043793003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e410cf70 msgr2=0x7fd5e410d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/2043793003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e410cf70 0x7fd5e410d340 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=11991514234314443107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d00099a0 tx=0x7fd5d002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:39.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/2043793003 shutdown_connections 2026-02-19T21:04:39.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/2043793003 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd5e4113180 0x7fd5e4173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/2043793003 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd5e410d960 0x7fd5e41129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/2043793003 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e410cf70 0x7fd5e410d340 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=11991514234314443107 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/2043793003 >> 10.20.193.90:0/2043793003 conn(0x7fd5e40ea870 msgr2=0x7fd5e410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/2043793003 shutdown_connections 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/2043793003 wait complete. 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 Processor -- start 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- start start 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd5e410cf70 0x7fd5e40606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd5e4113180 0x7fd5e4060c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 0x7fd5e4163290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e40626c0 con 0x7fd5e4061140 2026-02-19T21:04:39.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e41637d0 con 0x7fd5e410cf70 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.403+0000 7fd5e9b886c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e4163990 con 0x7fd5e4113180 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 0x7fd5e4163290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 0x7fd5e4163290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43464/0 (socket says 10.20.193.90:43464) 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 -- 10.20.193.90:0/472684712 learned_addr learned my addr 10.20.193.90:0/472684712 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e37fe6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd5e410cf70 0x7fd5e40606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e2ffd6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd5e4113180 0x7fd5e4060c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 -- 10.20.193.90:0/472684712 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd5e4113180 msgr2=0x7fd5e4060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd5e4113180 0x7fd5e4060c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 -- 10.20.193.90:0/472684712 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd5e410cf70 msgr2=0x7fd5e40606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd5e410cf70 0x7fd5e40606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 -- 10.20.193.90:0/472684712 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d0009590 con 0x7fd5e4061140 2026-02-19T21:04:39.409 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e3fff6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 0x7fd5e4163290 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d800c730 tx=0x7fd5d800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5d8003a30 con 0x7fd5e4061140 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd5d800a030 con 0x7fd5e4061140 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd5d800dc00 con 0x7fd5e4061140 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e4163c70 con 0x7fd5e4061140 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e4164100 con 0x7fd5e4061140 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.404+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e410e240 con 0x7fd5e4061140 2026-02-19T21:04:39.410 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.405+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 14) ==== 157083+0+0 (secure 0 0 0) 0x7fd5d8005080 con 0x7fd5e4061140 2026-02-19T21:04:39.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.406+0000 7fd5e0ff96c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd5b80b56d0 0x7fd5b80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.406+0000 7fd5e37fe6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd5b80b56d0 0x7fd5b80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.406+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fd5d80e4b20 con 0x7fd5e4061140 2026-02-19T21:04:39.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.407+0000 7fd5e37fe6c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd5b80b56d0 0x7fd5b80d5b80 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d00023e0 tx=0x7fd5d0005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:39.411 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.407+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd5d80a75d0 con 0x7fd5e4061140 2026-02-19T21:04:39.500 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.498+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e410d960 con 0x7fd5e4061140 2026-02-19T21:04:39.501 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.499+0000 7fd5e0ff96c0 1 -- 10.20.193.90:0/472684712 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22328 (secure 0 0 0) 0x7fd5d80aa780 con 0x7fd5e4061140 2026-02-19T21:04:39.502 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:39.502 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":75,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","created":"2026-02-19T21:02:03.870776+0000","modified":"2026-02-19T21:04:32.278599+0000","last_up_change":"2026-02-19T21:04:15.914313+0000","last_in_change":"2026-02-19T21:04:07.215369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T21:03:11.280767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-19T21:04:28.620551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-19T21:04:29.792203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9447a1db-db31-41c0-8732-78156b284c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6803","nonce":300222624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6805","nonce":300222624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6809","nonce":300222624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6807","nonce":300222624}]},"public_addr":"10.20.193.90:6803/300222624","cluster_addr":"10.20.193.90:6805/300222624","heartbeat_back_addr":"10.20.193.90:6809/300222624","heartbeat_front_addr":"10.20.193.90:6807/300222624","state":["exists","up"]},{"osd":1,"uuid":"2ceb6ac4-0471-49bc-b664-7b5053f54250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6801","nonce":515149626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6803","nonce":515149626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6807","nonce":515149626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6805","nonce":515149626}]},"public_addr":"10.20.193.105:6801/515149626","cluster_addr":"10.20.193.105:6803/515149626","heartbeat_back_addr":"10.20.193.105:6807/515149626","heartbeat_front_addr":"10.20.193.105:6805/515149626","state":["exists","up"]},{"osd":2,"uuid":"8ded8050-146f-41a3-a2e7-974118414769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6800","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6801","nonce":2163707084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6802","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6803","nonce":2163707084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6806","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6807","nonce":2163707084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6804","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6805","nonce":2163707084}]},"public_addr":"10.20.193.175:6801/2163707084","cluster_addr":"10.20.193.175:6803/2163707084","heartbeat_back_addr":"10.20.193.175:6807/2163707084","heartbeat_front_addr":"10.20.193.175:6805/2163707084","state":["exists","up"]},{"osd":3,"uuid":"556df040-373e-4795-af5e-297ede87881b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6811","nonce":1075832494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6813","nonce":1075832494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6817","nonce":1075832494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6815","nonce":1075832494}]},"public_addr":"10.20.193.90:6811/1075832494","cluster_addr":"10.20.193.90:6813/1075832494","heartbeat_back_addr":"10.20.193.90:6817/1075832494","heartbeat_front_addr":"10.20.193.90:6815/1075832494","state":["exists","up"]},{"osd":4,"uuid":"a0776450-d439-4c5d-a67d-0ae50bb72319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6809","nonce":891701520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6811","nonce":891701520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6815","nonce":891701520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6813","nonce":891701520}]},"public_addr":"10.20.193.105:6809/891701520","cluster_addr":"10.20.193.105:6811/891701520","heartbeat_back_addr":"10.20.193.105:6815/891701520","heartbeat_front_addr":"10.20.193.105:6813/891701520","state":["exists","up"]},{"osd":5,"uuid":"3450f832-0b90-45d7-a92d-b74809259564","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6808","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6809","nonce":1433153714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6810","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6811","nonce":1433153714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6814","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6815","nonce":1433153714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6812","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6813","nonce":1433153714}]},"public_addr":"10.20.193.175:6809/1433153714","cluster_addr":"10.20.193.175:6811/1433153714","heartbeat_back_addr":"10.20.193.175:6815/1433153714","heartbeat_front_addr":"10.20.193.175:6813/1433153714","state":["exists","up"]},{"osd":6,"uuid":"9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6819","nonce":4121266153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6821","nonce":4121266153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6825","nonce":4121266153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6823","nonce":4121266153}]},"public_addr":"10.20.193.90:6819/4121266153","cluster_addr":"10.20.193.90:6821/4121266153","heartbeat_back_addr":"10.20.193.90:6825/4121266153","heartbeat_front_addr":"10.20.193.90:6823/4121266153","state":["exists","up"]},{"osd":7,"uuid":"6b119453-b94f-441f-8685-a992fe2922ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6817","nonce":3597166844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6818","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6819","nonce":3597166844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6822","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6823","nonce":3597166844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6820","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6821","nonce":3597166844}]},"public_addr":"10.20.193.105:6817/3597166844","cluster_addr":"10.20.193.105:6819/3597166844","heartbeat_back_addr":"10.20.193.105:6823/3597166844","heartbeat_front_addr":"10.20.193.105:6821/3597166844","state":["exists","up"]},{"osd":8,"uuid":"fdfc8889-7eda-48ef-ae9d-5ec9cb798a56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6816","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6817","nonce":711294156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6818","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6819","nonce":711294156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6822","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6823","nonce":711294156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6820","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6821","nonce":711294156}]},"public_addr":"10.20.193.175:6817/711294156","cluster_addr":"10.20.193.175:6819/711294156","heartbeat_back_addr":"10.20.193.175:6823/711294156","heartbeat_front_addr":"10.20.193.175:6821/711294156","state":["exists","up"]},{"osd":9,"uuid":"bfa36c36-03aa-4363-85f7-b4cd9450b612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6827","nonce":72013082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6829","nonce":72013082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6833","nonce":72013082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6831","nonce":72013082}]},"public_addr":"10.20.193.90:6827/72013082","cluster_addr":"10.20.193.90:6829/72013082","heartbeat_back_addr":"10.20.193.90:6833/72013082","heartbeat_front_addr":"10.20.193.90:6831/72013082","state":["exists","up"]},{"osd":10,"uuid":"43e47e1a-7160-446c-8fe3-8a20cc2a4c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6824","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6825","nonce":3923796147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6826","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6827","nonce":3923796147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6830","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6831","nonce":3923796147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6828","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6829","nonce":3923796147}]},"public_addr":"10.20.193.105:6825/3923796147","cluster_addr":"10.20.193.105:6827/3923796147","heartbeat_back_addr":"10.20.193.105:6831/3923796147","heartbeat_front_addr":"10.20.193.105:6829/3923796147","state":["exists","up"]},{"osd":11,"uuid":"b789e6a7-be92-4cae-a3a0-d6eebe9b8629","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6824","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6825","nonce":3785438366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6826","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6827","nonce":3785438366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6830","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6831","nonce":3785438366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6828","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6829","nonce":3785438366}]},"public_addr":"10.20.193.175:6825/3785438366","cluster_addr":"10.20.193.175:6827/3785438366","heartbeat_back_addr":"10.20.193.175:6831/3785438366","heartbeat_front_addr":"10.20.193.175:6829/3785438366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:02:53.889642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:00.781533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:08.187332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:15.317071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:22.497099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:29.848931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:37.269086+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:44.452146+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:51.824076+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:59.325996+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:06.588398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:14.010218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/1864372684":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6800/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1997858222":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/66846304":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6801/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6800/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/2504907435":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6801/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1301435029":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/4201652812":"2026-02-20T21:02:09.876469+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T21:04:39.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd5b80b56d0 msgr2=0x7fd5b80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd5b80b56d0 0x7fd5b80d5b80 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d00023e0 tx=0x7fd5d0005c60 comp rx=0 tx=0).stop 2026-02-19T21:04:39.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 msgr2=0x7fd5e4163290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 0x7fd5e4163290 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d800c730 tx=0x7fd5d800cc00 comp rx=0 tx=0).stop 2026-02-19T21:04:39.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 shutdown_connections 2026-02-19T21:04:39.503 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd5b80b56d0 0x7fd5b80d5b80 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd5e4061140 0x7fd5e4163290 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd5e4113180 0x7fd5e4060c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 --2- 10.20.193.90:0/472684712 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd5e410cf70 0x7fd5e40606c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 >> 10.20.193.90:0/472684712 conn(0x7fd5e40ea870 msgr2=0x7fd5e410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:39.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 shutdown_connections 2026-02-19T21:04:39.504 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.500+0000 7fd5e9b886c0 1 -- 10.20.193.90:0/472684712 wait complete. 2026-02-19T21:04:39.541 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-19T21:04:39.542 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-19T21:04:39.664 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:39.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 -- 10.20.193.90:0/1976103133 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b810f200 msgr2=0x7f76b810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 --2- 10.20.193.90:0/1976103133 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b810f200 0x7f76b810f5d0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=15524722920261184360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76a40099a0 tx=0x7f76a402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 -- 10.20.193.90:0/1976103133 shutdown_connections 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 --2- 10.20.193.90:0/1976103133 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f76b8115410 0x7f76b8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 --2- 10.20.193.90:0/1976103133 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f76b810fbf0 0x7f76b8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 --2- 10.20.193.90:0/1976103133 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b810f200 0x7f76b810f5d0 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=15524722920261184360 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 -- 10.20.193.90:0/1976103133 >> 10.20.193.90:0/1976103133 conn(0x7f76b80eca60 msgr2=0x7f76b810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 -- 10.20.193.90:0/1976103133 shutdown_connections 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.778+0000 7f76be7806c0 1 -- 10.20.193.90:0/1976103133 wait complete. 2026-02-19T21:04:39.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 Processor -- start 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 -- start start 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f76b810f200 0x7f76b811d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f76b8115410 0x7f76b811d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 0x7f76b8123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8123690 con 0x7f76b8122c80 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8123800 con 0x7f76b8115410 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76b81239c0 con 0x7f76b810f200 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 0x7f76b8123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 0x7f76b8123120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43488/0 (socket says 10.20.193.90:43488) 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 -- 10.20.193.90:0/2650560967 learned_addr learned my addr 10.20.193.90:0/2650560967 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76b7fff6c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f76b810f200 0x7f76b811d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76b77fe6c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f76b8115410 0x7f76b811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 -- 10.20.193.90:0/2650560967 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f76b810f200 msgr2=0x7f76b811d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f76b810f200 0x7f76b811d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 -- 10.20.193.90:0/2650560967 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f76b8115410 msgr2=0x7f76b811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f76b8115410 0x7f76b811d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 -- 10.20.193.90:0/2650560967 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4009590 con 0x7f76b8122c80 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76bccf66c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 0x7f76b8123120 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76ac006ea0 tx=0x7f76ac00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76ac003a30 con 0x7f76b8122c80 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f76ac0054f0 con 0x7f76b8122c80 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b8163e70 con 0x7f76b8122c80 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f76ac00dcd0 con 0x7f76b8122c80 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.779+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b8164300 con 0x7f76b8122c80 2026-02-19T21:04:39.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.780+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b81104d0 con 0x7f76b8122c80 2026-02-19T21:04:39.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.781+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f76ac005030 con 0x7f76b8122c80 2026-02-19T21:04:39.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.781+0000 7f76b57fa6c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f768c0b5760 0x7f768c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:39.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.781+0000 7f76b7fff6c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f768c0b5760 0x7f768c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:39.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.781+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f76ac0e4d10 con 0x7f76b8122c80 2026-02-19T21:04:39.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.782+0000 7f76b7fff6c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f768c0b5760 0x7f768c0d5c10 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76a40092e0 tx=0x7f76a4005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:39.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.782+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f76ac0a76a0 con 0x7f76b8122c80 2026-02-19T21:04:39.876 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.874+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76b811e4d0 con 0x7f768c0b5760 2026-02-19T21:04:39.878 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.877+0000 7f76b57fa6c0 1 -- 10.20.193.90:0/2650560967 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258769 (secure 0 0 0) 0x7f76b811e4d0 con 0x7f768c0b5760 2026-02-19T21:04:39.881 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:39.883 INFO:teuthology.orchestra.run.trial090.stderr:dumped all 2026-02-19T21:04:39.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f768c0b5760 msgr2=0x7f768c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f768c0b5760 0x7f768c0d5c10 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76a40092e0 tx=0x7f76a4005c00 comp rx=0 tx=0).stop 2026-02-19T21:04:39.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 msgr2=0x7f76b8123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:39.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 0x7f76b8123120 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f76ac006ea0 tx=0x7f76ac00cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 shutdown_connections 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f768c0b5760 0x7f768c0d5c10 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f76b8122c80 0x7f76b8123120 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f76b8115410 0x7f76b811d8c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 --2- 10.20.193.90:0/2650560967 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f76b810f200 0x7f76b811d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 >> 10.20.193.90:0/2650560967 conn(0x7f76b80eca60 msgr2=0x7f76b810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 shutdown_connections 2026-02-19T21:04:39.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:39.879+0000 7f76be7806c0 1 -- 10.20.193.90:0/2650560967 wait complete. 2026-02-19T21:04:39.919 INFO:teuthology.orchestra.run.trial090.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2026-02-19T21:04:38.878714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":618529,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":137,"num_write":306,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335004,"kb_used_data":11436,"kb_used_omap":362,"kb_used_meta":322965,"kb_avail":8807703396,"statfs":{"total":9019431321600,"available":9019088277504,"internally_reserved":0,"allocated":11710464,"data_stored":6521726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":370790,"internal_metadata":330717082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28161,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":17,"num_read_kb":38,"num_write":117,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001438"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306620+0000","last_change":"2026-02-19T21:04:31.287002+0000","last_active":"2026-02-19T21:04:32.306620+0000","last_peered":"2026-02-19T21:04:32.306620+0000","last_clean":"2026-02-19T21:04:32.306620+0000","last_became_active":"2026-02-19T21:04:31.286342+0000","last_became_peered":"2026-02-19T21:04:31.286342+0000","last_unstale":"2026-02-19T21:04:32.306620+0000","last_undegraded":"2026-02-19T21:04:32.306620+0000","last_fullsized":"2026-02-19T21:04:32.306620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:10:00.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304824+0000","last_change":"2026-02-19T21:04:31.285136+0000","last_active":"2026-02-19T21:04:32.304824+0000","last_peered":"2026-02-19T21:04:32.304824+0000","last_clean":"2026-02-19T21:04:32.304824+0000","last_became_active":"2026-02-19T21:04:31.284945+0000","last_became_peered":"2026-02-19T21:04:31.284945+0000","last_unstale":"2026-02-19T21:04:32.304824+0000","last_undegraded":"2026-02-19T21:04:32.304824+0000","last_fullsized":"2026-02-19T21:04:32.304824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:08:07.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304888+0000","last_change":"2026-02-19T21:04:31.286791+0000","last_active":"2026-02-19T21:04:32.304888+0000","last_peered":"2026-02-19T21:04:32.304888+0000","last_clean":"2026-02-19T21:04:32.304888+0000","last_became_active":"2026-02-19T21:04:31.286150+0000","last_became_peered":"2026-02-19T21:04:31.286150+0000","last_unstale":"2026-02-19T21:04:32.304888+0000","last_undegraded":"2026-02-19T21:04:32.304888+0000","last_fullsized":"2026-02-19T21:04:32.304888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:29:44.208057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306002+0000","last_change":"2026-02-19T21:04:31.287914+0000","last_active":"2026-02-19T21:04:32.306002+0000","last_peered":"2026-02-19T21:04:32.306002+0000","last_clean":"2026-02-19T21:04:32.306002+0000","last_became_active":"2026-02-19T21:04:31.287376+0000","last_became_peered":"2026-02-19T21:04:31.287376+0000","last_unstale":"2026-02-19T21:04:32.306002+0000","last_undegraded":"2026-02-19T21:04:32.306002+0000","last_fullsized":"2026-02-19T21:04:32.306002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:27:40.549645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282804+0000","last_change":"2026-02-19T21:04:31.286299+0000","last_active":"2026-02-19T21:04:32.282804+0000","last_peered":"2026-02-19T21:04:32.282804+0000","last_clean":"2026-02-19T21:04:32.282804+0000","last_became_active":"2026-02-19T21:04:31.285600+0000","last_became_peered":"2026-02-19T21:04:31.285600+0000","last_unstale":"2026-02-19T21:04:32.282804+0000","last_undegraded":"2026-02-19T21:04:32.282804+0000","last_fullsized":"2026-02-19T21:04:32.282804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:26:00.465870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282241+0000","last_change":"2026-02-19T21:04:31.285609+0000","last_active":"2026-02-19T21:04:32.282241+0000","last_peered":"2026-02-19T21:04:32.282241+0000","last_clean":"2026-02-19T21:04:32.282241+0000","last_became_active":"2026-02-19T21:04:31.285465+0000","last_became_peered":"2026-02-19T21:04:31.285465+0000","last_unstale":"2026-02-19T21:04:32.282241+0000","last_undegraded":"2026-02-19T21:04:32.282241+0000","last_fullsized":"2026-02-19T21:04:32.282241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:10.356903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440798+0000","last_change":"2026-02-19T21:04:31.287193+0000","last_active":"2026-02-19T21:04:32.440798+0000","last_peered":"2026-02-19T21:04:32.440798+0000","last_clean":"2026-02-19T21:04:32.440798+0000","last_became_active":"2026-02-19T21:04:31.286850+0000","last_became_peered":"2026-02-19T21:04:31.286850+0000","last_unstale":"2026-02-19T21:04:32.440798+0000","last_undegraded":"2026-02-19T21:04:32.440798+0000","last_fullsized":"2026-02-19T21:04:32.440798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:50.866916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304740+0000","last_change":"2026-02-19T21:04:31.287351+0000","last_active":"2026-02-19T21:04:32.304740+0000","last_peered":"2026-02-19T21:04:32.304740+0000","last_clean":"2026-02-19T21:04:32.304740+0000","last_became_active":"2026-02-19T21:04:31.287147+0000","last_became_peered":"2026-02-19T21:04:31.287147+0000","last_unstale":"2026-02-19T21:04:32.304740+0000","last_undegraded":"2026-02-19T21:04:32.304740+0000","last_fullsized":"2026-02-19T21:04:32.304740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:45.877506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305201+0000","last_change":"2026-02-19T21:04:31.288496+0000","last_active":"2026-02-19T21:04:32.305201+0000","last_peered":"2026-02-19T21:04:32.305201+0000","last_clean":"2026-02-19T21:04:32.305201+0000","last_became_active":"2026-02-19T21:04:31.288194+0000","last_became_peered":"2026-02-19T21:04:31.288194+0000","last_unstale":"2026-02-19T21:04:32.305201+0000","last_undegraded":"2026-02-19T21:04:32.305201+0000","last_fullsized":"2026-02-19T21:04:32.305201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:00:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282691+0000","last_change":"2026-02-19T21:04:31.288303+0000","last_active":"2026-02-19T21:04:32.282691+0000","last_peered":"2026-02-19T21:04:32.282691+0000","last_clean":"2026-02-19T21:04:32.282691+0000","last_became_active":"2026-02-19T21:04:31.288160+0000","last_became_peered":"2026-02-19T21:04:31.288160+0000","last_unstale":"2026-02-19T21:04:32.282691+0000","last_undegraded":"2026-02-19T21:04:32.282691+0000","last_fullsized":"2026-02-19T21:04:32.282691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:47:29.467905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441339+0000","last_change":"2026-02-19T21:04:31.287633+0000","last_active":"2026-02-19T21:04:32.441339+0000","last_peered":"2026-02-19T21:04:32.441339+0000","last_clean":"2026-02-19T21:04:32.441339+0000","last_became_active":"2026-02-19T21:04:31.287434+0000","last_became_peered":"2026-02-19T21:04:31.287434+0000","last_unstale":"2026-02-19T21:04:32.441339+0000","last_undegraded":"2026-02-19T21:04:32.441339+0000","last_fullsized":"2026-02-19T21:04:32.441339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:34:20.533516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305980+0000","last_change":"2026-02-19T21:04:31.288404+0000","last_active":"2026-02-19T21:04:32.305980+0000","last_peered":"2026-02-19T21:04:32.305980+0000","last_clean":"2026-02-19T21:04:32.305980+0000","last_became_active":"2026-02-19T21:04:31.287620+0000","last_became_peered":"2026-02-19T21:04:31.287620+0000","last_unstale":"2026-02-19T21:04:32.305980+0000","last_undegraded":"2026-02-19T21:04:32.305980+0000","last_fullsized":"2026-02-19T21:04:32.305980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:25.760231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304889+0000","last_change":"2026-02-19T21:04:31.285595+0000","last_active":"2026-02-19T21:04:32.304889+0000","last_peered":"2026-02-19T21:04:32.304889+0000","last_clean":"2026-02-19T21:04:32.304889+0000","last_became_active":"2026-02-19T21:04:31.285372+0000","last_became_peered":"2026-02-19T21:04:31.285372+0000","last_unstale":"2026-02-19T21:04:32.304889+0000","last_undegraded":"2026-02-19T21:04:32.304889+0000","last_fullsized":"2026-02-19T21:04:32.304889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:35.546455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304606+0000","last_change":"2026-02-19T21:04:31.284499+0000","last_active":"2026-02-19T21:04:32.304606+0000","last_peered":"2026-02-19T21:04:32.304606+0000","last_clean":"2026-02-19T21:04:32.304606+0000","last_became_active":"2026-02-19T21:04:31.284262+0000","last_became_peered":"2026-02-19T21:04:31.284262+0000","last_unstale":"2026-02-19T21:04:32.304606+0000","last_undegraded":"2026-02-19T21:04:32.304606+0000","last_fullsized":"2026-02-19T21:04:32.304606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:48:14.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304506+0000","last_change":"2026-02-19T21:04:31.287280+0000","last_active":"2026-02-19T21:04:32.304506+0000","last_peered":"2026-02-19T21:04:32.304506+0000","last_clean":"2026-02-19T21:04:32.304506+0000","last_became_active":"2026-02-19T21:04:31.287026+0000","last_became_peered":"2026-02-19T21:04:31.287026+0000","last_unstale":"2026-02-19T21:04:32.304506+0000","last_undegraded":"2026-02-19T21:04:32.304506+0000","last_fullsized":"2026-02-19T21:04:32.304506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:15:11.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304856+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:32.304856+0000","last_peered":"2026-02-19T21:04:32.304856+0000","last_clean":"2026-02-19T21:04:32.304856+0000","last_became_active":"2026-02-19T21:04:31.286591+0000","last_became_peered":"2026-02-19T21:04:31.286591+0000","last_unstale":"2026-02-19T21:04:32.304856+0000","last_undegraded":"2026-02-19T21:04:32.304856+0000","last_fullsized":"2026-02-19T21:04:32.304856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:24:52.717294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306791+0000","last_change":"2026-02-19T21:04:31.287192+0000","last_active":"2026-02-19T21:04:32.306791+0000","last_peered":"2026-02-19T21:04:32.306791+0000","last_clean":"2026-02-19T21:04:32.306791+0000","last_became_active":"2026-02-19T21:04:31.287005+0000","last_became_peered":"2026-02-19T21:04:31.287005+0000","last_unstale":"2026-02-19T21:04:32.306791+0000","last_undegraded":"2026-02-19T21:04:32.306791+0000","last_fullsized":"2026-02-19T21:04:32.306791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:18.523767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.281063+0000","last_change":"2026-02-19T21:04:31.285298+0000","last_active":"2026-02-19T21:04:32.281063+0000","last_peered":"2026-02-19T21:04:32.281063+0000","last_clean":"2026-02-19T21:04:32.281063+0000","last_became_active":"2026-02-19T21:04:31.285047+0000","last_became_peered":"2026-02-19T21:04:31.285047+0000","last_unstale":"2026-02-19T21:04:32.281063+0000","last_undegraded":"2026-02-19T21:04:32.281063+0000","last_fullsized":"2026-02-19T21:04:32.281063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:32:45.124589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306260+0000","last_change":"2026-02-19T21:04:31.287399+0000","last_active":"2026-02-19T21:04:32.306260+0000","last_peered":"2026-02-19T21:04:32.306260+0000","last_clean":"2026-02-19T21:04:32.306260+0000","last_became_active":"2026-02-19T21:04:31.286835+0000","last_became_peered":"2026-02-19T21:04:31.286835+0000","last_unstale":"2026-02-19T21:04:32.306260+0000","last_undegraded":"2026-02-19T21:04:32.306260+0000","last_fullsized":"2026-02-19T21:04:32.306260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:16.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306360+0000","last_change":"2026-02-19T21:04:31.288156+0000","last_active":"2026-02-19T21:04:32.306360+0000","last_peered":"2026-02-19T21:04:32.306360+0000","last_clean":"2026-02-19T21:04:32.306360+0000","last_became_active":"2026-02-19T21:04:31.288012+0000","last_became_peered":"2026-02-19T21:04:31.288012+0000","last_unstale":"2026-02-19T21:04:32.306360+0000","last_undegraded":"2026-02-19T21:04:32.306360+0000","last_fullsized":"2026-02-19T21:04:32.306360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:05:48.712920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305037+0000","last_change":"2026-02-19T21:04:31.285690+0000","last_active":"2026-02-19T21:04:32.305037+0000","last_peered":"2026-02-19T21:04:32.305037+0000","last_clean":"2026-02-19T21:04:32.305037+0000","last_became_active":"2026-02-19T21:04:31.285498+0000","last_became_peered":"2026-02-19T21:04:31.285498+0000","last_unstale":"2026-02-19T21:04:32.305037+0000","last_undegraded":"2026-02-19T21:04:32.305037+0000","last_fullsized":"2026-02-19T21:04:32.305037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:48:40.789834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304918+0000","last_change":"2026-02-19T21:04:31.288360+0000","last_active":"2026-02-19T21:04:32.304918+0000","last_peered":"2026-02-19T21:04:32.304918+0000","last_clean":"2026-02-19T21:04:32.304918+0000","last_became_active":"2026-02-19T21:04:31.287849+0000","last_became_peered":"2026-02-19T21:04:31.287849+0000","last_unstale":"2026-02-19T21:04:32.304918+0000","last_undegraded":"2026-02-19T21:04:32.304918+0000","last_fullsized":"2026-02-19T21:04:32.304918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:24:06.399904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304776+0000","last_change":"2026-02-19T21:04:31.286420+0000","last_active":"2026-02-19T21:04:32.304776+0000","last_peered":"2026-02-19T21:04:32.304776+0000","last_clean":"2026-02-19T21:04:32.304776+0000","last_became_active":"2026-02-19T21:04:31.285905+0000","last_became_peered":"2026-02-19T21:04:31.285905+0000","last_unstale":"2026-02-19T21:04:32.304776+0000","last_undegraded":"2026-02-19T21:04:32.304776+0000","last_fullsized":"2026-02-19T21:04:32.304776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:07:02.537538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306236+0000","last_change":"2026-02-19T21:04:31.288706+0000","last_active":"2026-02-19T21:04:32.306236+0000","last_peered":"2026-02-19T21:04:32.306236+0000","last_clean":"2026-02-19T21:04:32.306236+0000","last_became_active":"2026-02-19T21:04:31.287837+0000","last_became_peered":"2026-02-19T21:04:31.287837+0000","last_unstale":"2026-02-19T21:04:32.306236+0000","last_undegraded":"2026-02-19T21:04:32.306236+0000","last_fullsized":"2026-02-19T21:04:32.306236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:33:01.082715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305204+0000","last_change":"2026-02-19T21:04:31.286807+0000","last_active":"2026-02-19T21:04:32.305204+0000","last_peered":"2026-02-19T21:04:32.305204+0000","last_clean":"2026-02-19T21:04:32.305204+0000","last_became_active":"2026-02-19T21:04:31.286555+0000","last_became_peered":"2026-02-19T21:04:31.286555+0000","last_unstale":"2026-02-19T21:04:32.305204+0000","last_undegraded":"2026-02-19T21:04:32.305204+0000","last_fullsized":"2026-02-19T21:04:32.305204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:33.064392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306361+0000","last_change":"2026-02-19T21:04:31.288135+0000","last_active":"2026-02-19T21:04:32.306361+0000","last_peered":"2026-02-19T21:04:32.306361+0000","last_clean":"2026-02-19T21:04:32.306361+0000","last_became_active":"2026-02-19T21:04:31.287889+0000","last_became_peered":"2026-02-19T21:04:31.287889+0000","last_unstale":"2026-02-19T21:04:32.306361+0000","last_undegraded":"2026-02-19T21:04:32.306361+0000","last_fullsized":"2026-02-19T21:04:32.306361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:41:33.753704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306523+0000","last_change":"2026-02-19T21:04:31.286954+0000","last_active":"2026-02-19T21:04:32.306523+0000","last_peered":"2026-02-19T21:04:32.306523+0000","last_clean":"2026-02-19T21:04:32.306523+0000","last_became_active":"2026-02-19T21:04:31.286509+0000","last_became_peered":"2026-02-19T21:04:31.286509+0000","last_unstale":"2026-02-19T21:04:32.306523+0000","last_undegraded":"2026-02-19T21:04:32.306523+0000","last_fullsized":"2026-02-19T21:04:32.306523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:03.051404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305010+0000","last_change":"2026-02-19T21:04:31.288452+0000","last_active":"2026-02-19T21:04:32.305010+0000","last_peered":"2026-02-19T21:04:32.305010+0000","last_clean":"2026-02-19T21:04:32.305010+0000","last_became_active":"2026-02-19T21:04:31.288288+0000","last_became_peered":"2026-02-19T21:04:31.288288+0000","last_unstale":"2026-02-19T21:04:32.305010+0000","last_undegraded":"2026-02-19T21:04:32.305010+0000","last_fullsized":"2026-02-19T21:04:32.305010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:36:20.116850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304875+0000","last_change":"2026-02-19T21:04:31.287437+0000","last_active":"2026-02-19T21:04:32.304875+0000","last_peered":"2026-02-19T21:04:32.304875+0000","last_clean":"2026-02-19T21:04:32.304875+0000","last_became_active":"2026-02-19T21:04:31.287292+0000","last_became_peered":"2026-02-19T21:04:31.287292+0000","last_unstale":"2026-02-19T21:04:32.304875+0000","last_undegraded":"2026-02-19T21:04:32.304875+0000","last_fullsized":"2026-02-19T21:04:32.304875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:27.235359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305871+0000","last_change":"2026-02-19T21:04:31.286030+0000","last_active":"2026-02-19T21:04:32.305871+0000","last_peered":"2026-02-19T21:04:32.305871+0000","last_clean":"2026-02-19T21:04:32.305871+0000","last_became_active":"2026-02-19T21:04:31.285556+0000","last_became_peered":"2026-02-19T21:04:31.285556+0000","last_unstale":"2026-02-19T21:04:32.305871+0000","last_undegraded":"2026-02-19T21:04:32.305871+0000","last_fullsized":"2026-02-19T21:04:32.305871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:09:01.348835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305872+0000","last_change":"2026-02-19T21:04:31.289211+0000","last_active":"2026-02-19T21:04:32.305872+0000","last_peered":"2026-02-19T21:04:32.305872+0000","last_clean":"2026-02-19T21:04:32.305872+0000","last_became_active":"2026-02-19T21:04:31.288961+0000","last_became_peered":"2026-02-19T21:04:31.288961+0000","last_unstale":"2026-02-19T21:04:32.305872+0000","last_undegraded":"2026-02-19T21:04:32.305872+0000","last_fullsized":"2026-02-19T21:04:32.305872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:03:11.179940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306191+0000","last_change":"2026-02-19T21:04:31.288628+0000","last_active":"2026-02-19T21:04:32.306191+0000","last_peered":"2026-02-19T21:04:32.306191+0000","last_clean":"2026-02-19T21:04:32.306191+0000","last_became_active":"2026-02-19T21:04:31.288458+0000","last_became_peered":"2026-02-19T21:04:31.288458+0000","last_unstale":"2026-02-19T21:04:32.306191+0000","last_undegraded":"2026-02-19T21:04:32.306191+0000","last_fullsized":"2026-02-19T21:04:32.306191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:24:59.338008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282712+0000","last_change":"2026-02-19T21:04:31.287078+0000","last_active":"2026-02-19T21:04:32.282712+0000","last_peered":"2026-02-19T21:04:32.282712+0000","last_clean":"2026-02-19T21:04:32.282712+0000","last_became_active":"2026-02-19T21:04:31.286730+0000","last_became_peered":"2026-02-19T21:04:31.286730+0000","last_unstale":"2026-02-19T21:04:32.282712+0000","last_undegraded":"2026-02-19T21:04:32.282712+0000","last_fullsized":"2026-02-19T21:04:32.282712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:52:57.154998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719502+0000","last_change":"2026-02-19T21:04:30.410537+0000","last_active":"2026-02-19T21:04:34.719502+0000","last_peered":"2026-02-19T21:04:34.719502+0000","last_clean":"2026-02-19T21:04:34.719502+0000","last_became_active":"2026-02-19T21:04:30.410253+0000","last_became_peered":"2026-02-19T21:04:30.410253+0000","last_unstale":"2026-02-19T21:04:34.719502+0000","last_undegraded":"2026-02-19T21:04:34.719502+0000","last_fullsized":"2026-02-19T21:04:34.719502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:43:09.872775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306558+0000","last_change":"2026-02-19T21:04:31.289847+0000","last_active":"2026-02-19T21:04:32.306558+0000","last_peered":"2026-02-19T21:04:32.306558+0000","last_clean":"2026-02-19T21:04:32.306558+0000","last_became_active":"2026-02-19T21:04:31.289674+0000","last_became_peered":"2026-02-19T21:04:31.289674+0000","last_unstale":"2026-02-19T21:04:32.306558+0000","last_undegraded":"2026-02-19T21:04:32.306558+0000","last_fullsized":"2026-02-19T21:04:32.306558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:19:57.744963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.724781+0000","last_change":"2026-02-19T21:04:30.411183+0000","last_active":"2026-02-19T21:04:35.724781+0000","last_peered":"2026-02-19T21:04:35.724781+0000","last_clean":"2026-02-19T21:04:35.724781+0000","last_became_active":"2026-02-19T21:04:30.410927+0000","last_became_peered":"2026-02-19T21:04:30.410927+0000","last_unstale":"2026-02-19T21:04:35.724781+0000","last_undegraded":"2026-02-19T21:04:35.724781+0000","last_fullsized":"2026-02-19T21:04:35.724781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:27:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.724614+0000","last_change":"2026-02-19T21:04:30.407656+0000","last_active":"2026-02-19T21:04:35.724614+0000","last_peered":"2026-02-19T21:04:35.724614+0000","last_clean":"2026-02-19T21:04:35.724614+0000","last_became_active":"2026-02-19T21:04:30.407355+0000","last_became_peered":"2026-02-19T21:04:30.407355+0000","last_unstale":"2026-02-19T21:04:35.724614+0000","last_undegraded":"2026-02-19T21:04:35.724614+0000","last_fullsized":"2026-02-19T21:04:35.724614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:45:24.893068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304795+0000","last_change":"2026-02-19T21:04:31.282577+0000","last_active":"2026-02-19T21:04:32.304795+0000","last_peered":"2026-02-19T21:04:32.304795+0000","last_clean":"2026-02-19T21:04:32.304795+0000","last_became_active":"2026-02-19T21:04:31.282337+0000","last_became_peered":"2026-02-19T21:04:31.282337+0000","last_unstale":"2026-02-19T21:04:32.304795+0000","last_undegraded":"2026-02-19T21:04:32.304795+0000","last_fullsized":"2026-02-19T21:04:32.304795+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:16:10.971557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306615+0000","last_change":"2026-02-19T21:04:30.409768+0000","last_active":"2026-02-19T21:04:32.306615+0000","last_peered":"2026-02-19T21:04:32.306615+0000","last_clean":"2026-02-19T21:04:32.306615+0000","last_became_active":"2026-02-19T21:04:30.409536+0000","last_became_peered":"2026-02-19T21:04:30.409536+0000","last_unstale":"2026-02-19T21:04:32.306615+0000","last_undegraded":"2026-02-19T21:04:32.306615+0000","last_fullsized":"2026-02-19T21:04:32.306615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:59.805182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.280885+0000","last_change":"2026-02-19T21:04:31.284256+0000","last_active":"2026-02-19T21:04:32.280885+0000","last_peered":"2026-02-19T21:04:32.280885+0000","last_clean":"2026-02-19T21:04:32.280885+0000","last_became_active":"2026-02-19T21:04:31.284072+0000","last_became_peered":"2026-02-19T21:04:31.284072+0000","last_unstale":"2026-02-19T21:04:32.280885+0000","last_undegraded":"2026-02-19T21:04:32.280885+0000","last_fullsized":"2026-02-19T21:04:32.280885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:06:45.684098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:36.728545+0000","last_change":"2026-02-19T21:04:30.411605+0000","last_active":"2026-02-19T21:04:36.728545+0000","last_peered":"2026-02-19T21:04:36.728545+0000","last_clean":"2026-02-19T21:04:36.728545+0000","last_became_active":"2026-02-19T21:04:30.411457+0000","last_became_peered":"2026-02-19T21:04:30.411457+0000","last_unstale":"2026-02-19T21:04:36.728545+0000","last_undegraded":"2026-02-19T21:04:36.728545+0000","last_fullsized":"2026-02-19T21:04:36.728545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:03:03.301109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305185+0000","last_change":"2026-02-19T21:04:31.286695+0000","last_active":"2026-02-19T21:04:32.305185+0000","last_peered":"2026-02-19T21:04:32.305185+0000","last_clean":"2026-02-19T21:04:32.305185+0000","last_became_active":"2026-02-19T21:04:31.286522+0000","last_became_peered":"2026-02-19T21:04:31.286522+0000","last_unstale":"2026-02-19T21:04:32.305185+0000","last_undegraded":"2026-02-19T21:04:32.305185+0000","last_fullsized":"2026-02-19T21:04:32.305185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:49:26.698378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718027+0000","last_change":"2026-02-19T21:04:30.409642+0000","last_active":"2026-02-19T21:04:34.718027+0000","last_peered":"2026-02-19T21:04:34.718027+0000","last_clean":"2026-02-19T21:04:34.718027+0000","last_became_active":"2026-02-19T21:04:30.409369+0000","last_became_peered":"2026-02-19T21:04:30.409369+0000","last_unstale":"2026-02-19T21:04:34.718027+0000","last_undegraded":"2026-02-19T21:04:34.718027+0000","last_fullsized":"2026-02-19T21:04:34.718027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:42:09.905781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304917+0000","last_change":"2026-02-19T21:04:31.287134+0000","last_active":"2026-02-19T21:04:32.304917+0000","last_peered":"2026-02-19T21:04:32.304917+0000","last_clean":"2026-02-19T21:04:32.304917+0000","last_became_active":"2026-02-19T21:04:31.286957+0000","last_became_peered":"2026-02-19T21:04:31.286957+0000","last_unstale":"2026-02-19T21:04:32.304917+0000","last_undegraded":"2026-02-19T21:04:32.304917+0000","last_fullsized":"2026-02-19T21:04:32.304917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:20:14.188668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306690+0000","last_change":"2026-02-19T21:04:30.410806+0000","last_active":"2026-02-19T21:04:32.306690+0000","last_peered":"2026-02-19T21:04:32.306690+0000","last_clean":"2026-02-19T21:04:32.306690+0000","last_became_active":"2026-02-19T21:04:30.410547+0000","last_became_peered":"2026-02-19T21:04:30.410547+0000","last_unstale":"2026-02-19T21:04:32.306690+0000","last_undegraded":"2026-02-19T21:04:32.306690+0000","last_fullsized":"2026-02-19T21:04:32.306690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:43:04.471874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305070+0000","last_change":"2026-02-19T21:04:31.288726+0000","last_active":"2026-02-19T21:04:32.305070+0000","last_peered":"2026-02-19T21:04:32.305070+0000","last_clean":"2026-02-19T21:04:32.305070+0000","last_became_active":"2026-02-19T21:04:31.288355+0000","last_became_peered":"2026-02-19T21:04:31.288355+0000","last_unstale":"2026-02-19T21:04:32.305070+0000","last_undegraded":"2026-02-19T21:04:32.305070+0000","last_fullsized":"2026-02-19T21:04:32.305070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:23:35.206511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:37.730808+0000","last_change":"2026-02-19T21:04:30.411062+0000","last_active":"2026-02-19T21:04:37.730808+0000","last_peered":"2026-02-19T21:04:37.730808+0000","last_clean":"2026-02-19T21:04:37.730808+0000","last_became_active":"2026-02-19T21:04:30.410903+0000","last_became_peered":"2026-02-19T21:04:30.410903+0000","last_unstale":"2026-02-19T21:04:37.730808+0000","last_undegraded":"2026-02-19T21:04:37.730808+0000","last_fullsized":"2026-02-19T21:04:37.730808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:54:52.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25594,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":28,"num_write":17,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282933+0000","last_change":"2026-02-19T21:04:31.287063+0000","last_active":"2026-02-19T21:04:32.282933+0000","last_peered":"2026-02-19T21:04:32.282933+0000","last_clean":"2026-02-19T21:04:32.282933+0000","last_became_active":"2026-02-19T21:04:31.286765+0000","last_became_peered":"2026-02-19T21:04:31.286765+0000","last_unstale":"2026-02-19T21:04:32.282933+0000","last_undegraded":"2026-02-19T21:04:32.282933+0000","last_fullsized":"2026-02-19T21:04:32.282933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:15:56.935874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719108+0000","last_change":"2026-02-19T21:04:30.411559+0000","last_active":"2026-02-19T21:04:34.719108+0000","last_peered":"2026-02-19T21:04:34.719108+0000","last_clean":"2026-02-19T21:04:34.719108+0000","last_became_active":"2026-02-19T21:04:30.411317+0000","last_became_peered":"2026-02-19T21:04:30.411317+0000","last_unstale":"2026-02-19T21:04:34.719108+0000","last_undegraded":"2026-02-19T21:04:34.719108+0000","last_fullsized":"2026-02-19T21:04:34.719108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:55.609906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304856+0000","last_change":"2026-02-19T21:04:31.286692+0000","last_active":"2026-02-19T21:04:32.304856+0000","last_peered":"2026-02-19T21:04:32.304856+0000","last_clean":"2026-02-19T21:04:32.304856+0000","last_became_active":"2026-02-19T21:04:31.286343+0000","last_became_peered":"2026-02-19T21:04:31.286343+0000","last_unstale":"2026-02-19T21:04:32.304856+0000","last_undegraded":"2026-02-19T21:04:32.304856+0000","last_fullsized":"2026-02-19T21:04:32.304856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:34:53.155015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719388+0000","last_change":"2026-02-19T21:04:30.409868+0000","last_active":"2026-02-19T21:04:34.719388+0000","last_peered":"2026-02-19T21:04:34.719388+0000","last_clean":"2026-02-19T21:04:34.719388+0000","last_became_active":"2026-02-19T21:04:30.409568+0000","last_became_peered":"2026-02-19T21:04:30.409568+0000","last_unstale":"2026-02-19T21:04:34.719388+0000","last_undegraded":"2026-02-19T21:04:34.719388+0000","last_fullsized":"2026-02-19T21:04:34.719388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:45:25.596378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441222+0000","last_change":"2026-02-19T21:04:31.288696+0000","last_active":"2026-02-19T21:04:32.441222+0000","last_peered":"2026-02-19T21:04:32.441222+0000","last_clean":"2026-02-19T21:04:32.441222+0000","last_became_active":"2026-02-19T21:04:31.288460+0000","last_became_peered":"2026-02-19T21:04:31.288460+0000","last_unstale":"2026-02-19T21:04:32.441222+0000","last_undegraded":"2026-02-19T21:04:32.441222+0000","last_fullsized":"2026-02-19T21:04:32.441222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:02.502851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305595+0000","last_change":"2026-02-19T21:04:30.409894+0000","last_active":"2026-02-19T21:04:32.305595+0000","last_peered":"2026-02-19T21:04:32.305595+0000","last_clean":"2026-02-19T21:04:32.305595+0000","last_became_active":"2026-02-19T21:04:30.409694+0000","last_became_peered":"2026-02-19T21:04:30.409694+0000","last_unstale":"2026-02-19T21:04:32.305595+0000","last_undegraded":"2026-02-19T21:04:32.305595+0000","last_fullsized":"2026-02-19T21:04:32.305595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:44:08.909989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440800+0000","last_change":"2026-02-19T21:04:31.289106+0000","last_active":"2026-02-19T21:04:32.440800+0000","last_peered":"2026-02-19T21:04:32.440800+0000","last_clean":"2026-02-19T21:04:32.440800+0000","last_became_active":"2026-02-19T21:04:31.288889+0000","last_became_peered":"2026-02-19T21:04:31.288889+0000","last_unstale":"2026-02-19T21:04:32.440800+0000","last_undegraded":"2026-02-19T21:04:32.440800+0000","last_fullsized":"2026-02-19T21:04:32.440800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:56:11.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.726783+0000","last_change":"2026-02-19T21:04:30.409277+0000","last_active":"2026-02-19T21:04:35.726783+0000","last_peered":"2026-02-19T21:04:35.726783+0000","last_clean":"2026-02-19T21:04:35.726783+0000","last_became_active":"2026-02-19T21:04:30.409098+0000","last_became_peered":"2026-02-19T21:04:30.409098+0000","last_unstale":"2026-02-19T21:04:35.726783+0000","last_undegraded":"2026-02-19T21:04:35.726783+0000","last_fullsized":"2026-02-19T21:04:35.726783+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:09:56.289622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306412+0000","last_change":"2026-02-19T21:04:31.289313+0000","last_active":"2026-02-19T21:04:32.306412+0000","last_peered":"2026-02-19T21:04:32.306412+0000","last_clean":"2026-02-19T21:04:32.306412+0000","last_became_active":"2026-02-19T21:04:31.288983+0000","last_became_peered":"2026-02-19T21:04:31.288983+0000","last_unstale":"2026-02-19T21:04:32.306412+0000","last_undegraded":"2026-02-19T21:04:32.306412+0000","last_fullsized":"2026-02-19T21:04:32.306412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:56.535103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:36.723692+0000","last_change":"2026-02-19T21:04:30.411049+0000","last_active":"2026-02-19T21:04:36.723692+0000","last_peered":"2026-02-19T21:04:36.723692+0000","last_clean":"2026-02-19T21:04:36.723692+0000","last_became_active":"2026-02-19T21:04:30.410550+0000","last_became_peered":"2026-02-19T21:04:30.410550+0000","last_unstale":"2026-02-19T21:04:36.723692+0000","last_undegraded":"2026-02-19T21:04:36.723692+0000","last_fullsized":"2026-02-19T21:04:36.723692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:08:50.397444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306487+0000","last_change":"2026-02-19T21:04:31.288124+0000","last_active":"2026-02-19T21:04:32.306487+0000","last_peered":"2026-02-19T21:04:32.306487+0000","last_clean":"2026-02-19T21:04:32.306487+0000","last_became_active":"2026-02-19T21:04:31.287990+0000","last_became_peered":"2026-02-19T21:04:31.287990+0000","last_unstale":"2026-02-19T21:04:32.306487+0000","last_undegraded":"2026-02-19T21:04:32.306487+0000","last_fullsized":"2026-02-19T21:04:32.306487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:27:38.346349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304912+0000","last_change":"2026-02-19T21:04:30.407979+0000","last_active":"2026-02-19T21:04:32.304912+0000","last_peered":"2026-02-19T21:04:32.304912+0000","last_clean":"2026-02-19T21:04:32.304912+0000","last_became_active":"2026-02-19T21:04:30.407755+0000","last_became_peered":"2026-02-19T21:04:30.407755+0000","last_unstale":"2026-02-19T21:04:32.304912+0000","last_undegraded":"2026-02-19T21:04:32.304912+0000","last_fullsized":"2026-02-19T21:04:32.304912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:55:43.366371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441377+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:32.441377+0000","last_peered":"2026-02-19T21:04:32.441377+0000","last_clean":"2026-02-19T21:04:32.441377+0000","last_became_active":"2026-02-19T21:04:31.286657+0000","last_became_peered":"2026-02-19T21:04:31.286657+0000","last_unstale":"2026-02-19T21:04:32.441377+0000","last_undegraded":"2026-02-19T21:04:32.441377+0000","last_fullsized":"2026-02-19T21:04:32.441377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:03.670491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306767+0000","last_change":"2026-02-19T21:04:30.410815+0000","last_active":"2026-02-19T21:04:32.306767+0000","last_peered":"2026-02-19T21:04:32.306767+0000","last_clean":"2026-02-19T21:04:32.306767+0000","last_became_active":"2026-02-19T21:04:30.410567+0000","last_became_peered":"2026-02-19T21:04:30.410567+0000","last_unstale":"2026-02-19T21:04:32.306767+0000","last_undegraded":"2026-02-19T21:04:32.306767+0000","last_fullsized":"2026-02-19T21:04:32.306767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:22.307313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441052+0000","last_change":"2026-02-19T21:04:31.288226+0000","last_active":"2026-02-19T21:04:32.441052+0000","last_peered":"2026-02-19T21:04:32.441052+0000","last_clean":"2026-02-19T21:04:32.441052+0000","last_became_active":"2026-02-19T21:04:31.287964+0000","last_became_peered":"2026-02-19T21:04:31.287964+0000","last_unstale":"2026-02-19T21:04:32.441052+0000","last_undegraded":"2026-02-19T21:04:32.441052+0000","last_fullsized":"2026-02-19T21:04:32.441052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:01.589256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305926+0000","last_change":"2026-02-19T21:04:30.408483+0000","last_active":"2026-02-19T21:04:32.305926+0000","last_peered":"2026-02-19T21:04:32.305926+0000","last_clean":"2026-02-19T21:04:32.305926+0000","last_became_active":"2026-02-19T21:04:30.408255+0000","last_became_peered":"2026-02-19T21:04:30.408255+0000","last_unstale":"2026-02-19T21:04:32.305926+0000","last_undegraded":"2026-02-19T21:04:32.305926+0000","last_fullsized":"2026-02-19T21:04:32.305926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:07:16.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441294+0000","last_change":"2026-02-19T21:04:31.287796+0000","last_active":"2026-02-19T21:04:32.441294+0000","last_peered":"2026-02-19T21:04:32.441294+0000","last_clean":"2026-02-19T21:04:32.441294+0000","last_became_active":"2026-02-19T21:04:31.287536+0000","last_became_peered":"2026-02-19T21:04:31.287536+0000","last_unstale":"2026-02-19T21:04:32.441294+0000","last_undegraded":"2026-02-19T21:04:32.441294+0000","last_fullsized":"2026-02-19T21:04:32.441294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:01.470441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440940+0000","last_change":"2026-02-19T21:04:12.238272+0000","last_active":"2026-02-19T21:04:32.440940+0000","last_peered":"2026-02-19T21:04:32.440940+0000","last_clean":"2026-02-19T21:04:32.440940+0000","last_became_active":"2026-02-19T21:04:12.238014+0000","last_became_peered":"2026-02-19T21:04:12.238014+0000","last_unstale":"2026-02-19T21:04:32.440940+0000","last_undegraded":"2026-02-19T21:04:32.440940+0000","last_fullsized":"2026-02-19T21:04:32.440940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_clean_scrub_stamp":"2026-02-19T21:03:12.107531+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:05:49.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305797+0000","last_change":"2026-02-19T21:04:30.410213+0000","last_active":"2026-02-19T21:04:32.305797+0000","last_peered":"2026-02-19T21:04:32.305797+0000","last_clean":"2026-02-19T21:04:32.305797+0000","last_became_active":"2026-02-19T21:04:30.410043+0000","last_became_peered":"2026-02-19T21:04:30.410043+0000","last_unstale":"2026-02-19T21:04:32.305797+0000","last_undegraded":"2026-02-19T21:04:32.305797+0000","last_fullsized":"2026-02-19T21:04:32.305797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:34:23.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304878+0000","last_change":"2026-02-19T21:04:31.285502+0000","last_active":"2026-02-19T21:04:32.304878+0000","last_peered":"2026-02-19T21:04:32.304878+0000","last_clean":"2026-02-19T21:04:32.304878+0000","last_became_active":"2026-02-19T21:04:31.285248+0000","last_became_peered":"2026-02-19T21:04:31.285248+0000","last_unstale":"2026-02-19T21:04:32.304878+0000","last_undegraded":"2026-02-19T21:04:32.304878+0000","last_fullsized":"2026-02-19T21:04:32.304878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:54.516813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.725634+0000","last_change":"2026-02-19T21:04:30.409547+0000","last_active":"2026-02-19T21:04:35.725634+0000","last_peered":"2026-02-19T21:04:35.725634+0000","last_clean":"2026-02-19T21:04:35.725634+0000","last_became_active":"2026-02-19T21:04:30.409191+0000","last_became_peered":"2026-02-19T21:04:30.409191+0000","last_unstale":"2026-02-19T21:04:35.725634+0000","last_undegraded":"2026-02-19T21:04:35.725634+0000","last_fullsized":"2026-02-19T21:04:35.725634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:14:53.157004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304789+0000","last_change":"2026-02-19T21:04:31.287071+0000","last_active":"2026-02-19T21:04:32.304789+0000","last_peered":"2026-02-19T21:04:32.304789+0000","last_clean":"2026-02-19T21:04:32.304789+0000","last_became_active":"2026-02-19T21:04:31.286826+0000","last_became_peered":"2026-02-19T21:04:31.286826+0000","last_unstale":"2026-02-19T21:04:32.304789+0000","last_undegraded":"2026-02-19T21:04:32.304789+0000","last_fullsized":"2026-02-19T21:04:32.304789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:26:22.218657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:37.729839+0000","last_change":"2026-02-19T21:04:30.407561+0000","last_active":"2026-02-19T21:04:37.729839+0000","last_peered":"2026-02-19T21:04:37.729839+0000","last_clean":"2026-02-19T21:04:37.729839+0000","last_became_active":"2026-02-19T21:04:30.407338+0000","last_became_peered":"2026-02-19T21:04:30.407338+0000","last_unstale":"2026-02-19T21:04:37.729839+0000","last_undegraded":"2026-02-19T21:04:37.729839+0000","last_fullsized":"2026-02-19T21:04:37.729839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:54:33.062163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306519+0000","last_change":"2026-02-19T21:04:31.289132+0000","last_active":"2026-02-19T21:04:32.306519+0000","last_peered":"2026-02-19T21:04:32.306519+0000","last_clean":"2026-02-19T21:04:32.306519+0000","last_became_active":"2026-02-19T21:04:31.288397+0000","last_became_peered":"2026-02-19T21:04:31.288397+0000","last_unstale":"2026-02-19T21:04:32.306519+0000","last_undegraded":"2026-02-19T21:04:32.306519+0000","last_fullsized":"2026-02-19T21:04:32.306519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:06:10.359363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441033+0000","last_change":"2026-02-19T21:04:30.409909+0000","last_active":"2026-02-19T21:04:32.441033+0000","last_peered":"2026-02-19T21:04:32.441033+0000","last_clean":"2026-02-19T21:04:32.441033+0000","last_became_active":"2026-02-19T21:04:30.409595+0000","last_became_peered":"2026-02-19T21:04:30.409595+0000","last_unstale":"2026-02-19T21:04:32.441033+0000","last_undegraded":"2026-02-19T21:04:32.441033+0000","last_fullsized":"2026-02-19T21:04:32.441033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:34:26.108002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282333+0000","last_change":"2026-02-19T21:04:31.286428+0000","last_active":"2026-02-19T21:04:32.282333+0000","last_peered":"2026-02-19T21:04:32.282333+0000","last_clean":"2026-02-19T21:04:32.282333+0000","last_became_active":"2026-02-19T21:04:31.286150+0000","last_became_peered":"2026-02-19T21:04:31.286150+0000","last_unstale":"2026-02-19T21:04:32.282333+0000","last_undegraded":"2026-02-19T21:04:32.282333+0000","last_fullsized":"2026-02-19T21:04:32.282333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:24:05.471458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.280914+0000","last_change":"2026-02-19T21:04:30.408729+0000","last_active":"2026-02-19T21:04:32.280914+0000","last_peered":"2026-02-19T21:04:32.280914+0000","last_clean":"2026-02-19T21:04:32.280914+0000","last_became_active":"2026-02-19T21:04:30.408489+0000","last_became_peered":"2026-02-19T21:04:30.408489+0000","last_unstale":"2026-02-19T21:04:32.280914+0000","last_undegraded":"2026-02-19T21:04:32.280914+0000","last_fullsized":"2026-02-19T21:04:32.280914+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:32.753162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:33.235599+0000","last_change":"2026-02-19T21:04:31.282620+0000","last_active":"2026-02-19T21:04:33.235599+0000","last_peered":"2026-02-19T21:04:33.235599+0000","last_clean":"2026-02-19T21:04:33.235599+0000","last_became_active":"2026-02-19T21:04:31.282207+0000","last_became_peered":"2026-02-19T21:04:31.282207+0000","last_unstale":"2026-02-19T21:04:33.235599+0000","last_undegraded":"2026-02-19T21:04:33.235599+0000","last_fullsized":"2026-02-19T21:04:33.235599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:22:05.657414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718711+0000","last_change":"2026-02-19T21:04:30.412136+0000","last_active":"2026-02-19T21:04:34.718711+0000","last_peered":"2026-02-19T21:04:34.718711+0000","last_clean":"2026-02-19T21:04:34.718711+0000","last_became_active":"2026-02-19T21:04:30.412001+0000","last_became_peered":"2026-02-19T21:04:30.412001+0000","last_unstale":"2026-02-19T21:04:34.718711+0000","last_undegraded":"2026-02-19T21:04:34.718711+0000","last_fullsized":"2026-02-19T21:04:34.718711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:27:51.577913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305006+0000","last_change":"2026-02-19T21:04:31.286103+0000","last_active":"2026-02-19T21:04:32.305006+0000","last_peered":"2026-02-19T21:04:32.305006+0000","last_clean":"2026-02-19T21:04:32.305006+0000","last_became_active":"2026-02-19T21:04:31.285858+0000","last_became_peered":"2026-02-19T21:04:31.285858+0000","last_unstale":"2026-02-19T21:04:32.305006+0000","last_undegraded":"2026-02-19T21:04:32.305006+0000","last_fullsized":"2026-02-19T21:04:32.305006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:34.696574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.724574+0000","last_change":"2026-02-19T21:04:30.409209+0000","last_active":"2026-02-19T21:04:35.724574+0000","last_peered":"2026-02-19T21:04:35.724574+0000","last_clean":"2026-02-19T21:04:35.724574+0000","last_became_active":"2026-02-19T21:04:30.409013+0000","last_became_peered":"2026-02-19T21:04:30.409013+0000","last_unstale":"2026-02-19T21:04:35.724574+0000","last_undegraded":"2026-02-19T21:04:35.724574+0000","last_fullsized":"2026-02-19T21:04:35.724574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:18.396001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305202+0000","last_change":"2026-02-19T21:04:31.286348+0000","last_active":"2026-02-19T21:04:32.305202+0000","last_peered":"2026-02-19T21:04:32.305202+0000","last_clean":"2026-02-19T21:04:32.305202+0000","last_became_active":"2026-02-19T21:04:31.286157+0000","last_became_peered":"2026-02-19T21:04:31.286157+0000","last_unstale":"2026-02-19T21:04:32.305202+0000","last_undegraded":"2026-02-19T21:04:32.305202+0000","last_fullsized":"2026-02-19T21:04:32.305202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:57:02.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305981+0000","last_change":"2026-02-19T21:04:30.409263+0000","last_active":"2026-02-19T21:04:32.305981+0000","last_peered":"2026-02-19T21:04:32.305981+0000","last_clean":"2026-02-19T21:04:32.305981+0000","last_became_active":"2026-02-19T21:04:30.408394+0000","last_became_peered":"2026-02-19T21:04:30.408394+0000","last_unstale":"2026-02-19T21:04:32.305981+0000","last_undegraded":"2026-02-19T21:04:32.305981+0000","last_fullsized":"2026-02-19T21:04:32.305981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:15:30.665040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304829+0000","last_change":"2026-02-19T21:04:31.287859+0000","last_active":"2026-02-19T21:04:32.304829+0000","last_peered":"2026-02-19T21:04:32.304829+0000","last_clean":"2026-02-19T21:04:32.304829+0000","last_became_active":"2026-02-19T21:04:31.287687+0000","last_became_peered":"2026-02-19T21:04:31.287687+0000","last_unstale":"2026-02-19T21:04:32.304829+0000","last_undegraded":"2026-02-19T21:04:32.304829+0000","last_fullsized":"2026-02-19T21:04:32.304829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:26:18.995690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718234+0000","last_change":"2026-02-19T21:04:30.410334+0000","last_active":"2026-02-19T21:04:34.718234+0000","last_peered":"2026-02-19T21:04:34.718234+0000","last_clean":"2026-02-19T21:04:34.718234+0000","last_became_active":"2026-02-19T21:04:30.409928+0000","last_became_peered":"2026-02-19T21:04:30.409928+0000","last_unstale":"2026-02-19T21:04:34.718234+0000","last_undegraded":"2026-02-19T21:04:34.718234+0000","last_fullsized":"2026-02-19T21:04:34.718234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:21:33.041734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282558+0000","last_change":"2026-02-19T21:04:31.286369+0000","last_active":"2026-02-19T21:04:32.282558+0000","last_peered":"2026-02-19T21:04:32.282558+0000","last_clean":"2026-02-19T21:04:32.282558+0000","last_became_active":"2026-02-19T21:04:31.285908+0000","last_became_peered":"2026-02-19T21:04:31.285908+0000","last_unstale":"2026-02-19T21:04:32.282558+0000","last_undegraded":"2026-02-19T21:04:32.282558+0000","last_fullsized":"2026-02-19T21:04:32.282558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:32:23.440567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718269+0000","last_change":"2026-02-19T21:04:30.410110+0000","last_active":"2026-02-19T21:04:34.718269+0000","last_peered":"2026-02-19T21:04:34.718269+0000","last_clean":"2026-02-19T21:04:34.718269+0000","last_became_active":"2026-02-19T21:04:30.409864+0000","last_became_peered":"2026-02-19T21:04:30.409864+0000","last_unstale":"2026-02-19T21:04:34.718269+0000","last_undegraded":"2026-02-19T21:04:34.718269+0000","last_fullsized":"2026-02-19T21:04:34.718269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:58:06.526168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306248+0000","last_change":"2026-02-19T21:04:31.287332+0000","last_active":"2026-02-19T21:04:32.306248+0000","last_peered":"2026-02-19T21:04:32.306248+0000","last_clean":"2026-02-19T21:04:32.306248+0000","last_became_active":"2026-02-19T21:04:31.287112+0000","last_became_peered":"2026-02-19T21:04:31.287112+0000","last_unstale":"2026-02-19T21:04:32.306248+0000","last_undegraded":"2026-02-19T21:04:32.306248+0000","last_fullsized":"2026-02-19T21:04:32.306248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:06:33.375075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305669+0000","last_change":"2026-02-19T21:04:30.410600+0000","last_active":"2026-02-19T21:04:32.305669+0000","last_peered":"2026-02-19T21:04:32.305669+0000","last_clean":"2026-02-19T21:04:32.305669+0000","last_became_active":"2026-02-19T21:04:30.410268+0000","last_became_peered":"2026-02-19T21:04:30.410268+0000","last_unstale":"2026-02-19T21:04:32.305669+0000","last_undegraded":"2026-02-19T21:04:32.305669+0000","last_fullsized":"2026-02-19T21:04:32.305669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:41:28.323119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304879+0000","last_change":"2026-02-19T21:04:31.284350+0000","last_active":"2026-02-19T21:04:32.304879+0000","last_peered":"2026-02-19T21:04:32.304879+0000","last_clean":"2026-02-19T21:04:32.304879+0000","last_became_active":"2026-02-19T21:04:31.284130+0000","last_became_peered":"2026-02-19T21:04:31.284130+0000","last_unstale":"2026-02-19T21:04:32.304879+0000","last_undegraded":"2026-02-19T21:04:32.304879+0000","last_fullsized":"2026-02-19T21:04:32.304879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:18:19.362792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719332+0000","last_change":"2026-02-19T21:04:30.411333+0000","last_active":"2026-02-19T21:04:34.719332+0000","last_peered":"2026-02-19T21:04:34.719332+0000","last_clean":"2026-02-19T21:04:34.719332+0000","last_became_active":"2026-02-19T21:04:30.411052+0000","last_became_peered":"2026-02-19T21:04:30.411052+0000","last_unstale":"2026-02-19T21:04:34.719332+0000","last_undegraded":"2026-02-19T21:04:34.719332+0000","last_fullsized":"2026-02-19T21:04:34.719332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:13:12.351852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440993+0000","last_change":"2026-02-19T21:04:31.287054+0000","last_active":"2026-02-19T21:04:32.440993+0000","last_peered":"2026-02-19T21:04:32.440993+0000","last_clean":"2026-02-19T21:04:32.440993+0000","last_became_active":"2026-02-19T21:04:31.286548+0000","last_became_peered":"2026-02-19T21:04:31.286548+0000","last_unstale":"2026-02-19T21:04:32.440993+0000","last_undegraded":"2026-02-19T21:04:32.440993+0000","last_fullsized":"2026-02-19T21:04:32.440993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:15.932826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306581+0000","last_change":"2026-02-19T21:04:31.289365+0000","last_active":"2026-02-19T21:04:32.306581+0000","last_peered":"2026-02-19T21:04:32.306581+0000","last_clean":"2026-02-19T21:04:32.306581+0000","last_became_active":"2026-02-19T21:04:31.288986+0000","last_became_peered":"2026-02-19T21:04:31.288986+0000","last_unstale":"2026-02-19T21:04:32.306581+0000","last_undegraded":"2026-02-19T21:04:32.306581+0000","last_fullsized":"2026-02-19T21:04:32.306581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:55:08.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282837+0000","last_change":"2026-02-19T21:04:30.410600+0000","last_active":"2026-02-19T21:04:32.282837+0000","last_peered":"2026-02-19T21:04:32.282837+0000","last_clean":"2026-02-19T21:04:32.282837+0000","last_became_active":"2026-02-19T21:04:30.410193+0000","last_became_peered":"2026-02-19T21:04:30.410193+0000","last_unstale":"2026-02-19T21:04:32.282837+0000","last_undegraded":"2026-02-19T21:04:32.282837+0000","last_fullsized":"2026-02-19T21:04:32.282837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:39:35.864646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305059+0000","last_change":"2026-02-19T21:04:31.287464+0000","last_active":"2026-02-19T21:04:32.305059+0000","last_peered":"2026-02-19T21:04:32.305059+0000","last_clean":"2026-02-19T21:04:32.305059+0000","last_became_active":"2026-02-19T21:04:31.287159+0000","last_became_peered":"2026-02-19T21:04:31.287159+0000","last_unstale":"2026-02-19T21:04:32.305059+0000","last_undegraded":"2026-02-19T21:04:32.305059+0000","last_fullsized":"2026-02-19T21:04:32.305059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:30:26.608871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.725561+0000","last_change":"2026-02-19T21:04:30.411307+0000","last_active":"2026-02-19T21:04:35.725561+0000","last_peered":"2026-02-19T21:04:35.725561+0000","last_clean":"2026-02-19T21:04:35.725561+0000","last_became_active":"2026-02-19T21:04:30.411044+0000","last_became_peered":"2026-02-19T21:04:30.411044+0000","last_unstale":"2026-02-19T21:04:35.725561+0000","last_undegraded":"2026-02-19T21:04:35.725561+0000","last_fullsized":"2026-02-19T21:04:35.725561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:39:22.516979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304983+0000","last_change":"2026-02-19T21:04:31.286139+0000","last_active":"2026-02-19T21:04:32.304983+0000","last_peered":"2026-02-19T21:04:32.304983+0000","last_clean":"2026-02-19T21:04:32.304983+0000","last_became_active":"2026-02-19T21:04:31.285718+0000","last_became_peered":"2026-02-19T21:04:31.285718+0000","last_unstale":"2026-02-19T21:04:32.304983+0000","last_undegraded":"2026-02-19T21:04:32.304983+0000","last_fullsized":"2026-02-19T21:04:32.304983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:15:18.002138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305250+0000","last_change":"2026-02-19T21:04:30.410568+0000","last_active":"2026-02-19T21:04:32.305250+0000","last_peered":"2026-02-19T21:04:32.305250+0000","last_clean":"2026-02-19T21:04:32.305250+0000","last_became_active":"2026-02-19T21:04:30.410323+0000","last_became_peered":"2026-02-19T21:04:30.410323+0000","last_unstale":"2026-02-19T21:04:32.305250+0000","last_undegraded":"2026-02-19T21:04:32.305250+0000","last_fullsized":"2026-02-19T21:04:32.305250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:14:30.270933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305147+0000","last_change":"2026-02-19T21:04:31.286019+0000","last_active":"2026-02-19T21:04:32.305147+0000","last_peered":"2026-02-19T21:04:32.305147+0000","last_clean":"2026-02-19T21:04:32.305147+0000","last_became_active":"2026-02-19T21:04:31.285608+0000","last_became_peered":"2026-02-19T21:04:31.285608+0000","last_unstale":"2026-02-19T21:04:32.305147+0000","last_undegraded":"2026-02-19T21:04:32.305147+0000","last_fullsized":"2026-02-19T21:04:32.305147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:34:30.034673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.725153+0000","last_change":"2026-02-19T21:04:30.409329+0000","last_active":"2026-02-19T21:04:35.725153+0000","last_peered":"2026-02-19T21:04:35.725153+0000","last_clean":"2026-02-19T21:04:35.725153+0000","last_became_active":"2026-02-19T21:04:30.408892+0000","last_became_peered":"2026-02-19T21:04:30.408892+0000","last_unstale":"2026-02-19T21:04:35.725153+0000","last_undegraded":"2026-02-19T21:04:35.725153+0000","last_fullsized":"2026-02-19T21:04:35.725153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:16:52.316860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":28044,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":17,"num_read_kb":38,"num_write":116,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115561,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710725,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":394318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8794,"internal_metadata":27581862},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939655,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28384,"kb_used_data":1420,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733974816,"statfs":{"total":751619276800,"available":751590211584,"internally_reserved":0,"allocated":1454080,"data_stored":994671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":395124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21808,"internal_metadata":27568848},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299403,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20493,"internal_metadata":27570163},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528331,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28348,"kb_used_data":1384,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733974852,"statfs":{"total":751619276800,"available":751590248448,"internally_reserved":0,"allocated":1417216,"data_stored":985912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26184,"internal_metadata":27564472},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27075,"internal_metadata":27563581},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888078,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28364,"kb_used_data":1400,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733974836,"statfs":{"total":751619276800,"available":751590232064,"internally_reserved":0,"allocated":1433600,"data_stored":986184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20015,"internal_metadata":27570641},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31913,"internal_metadata":27558743},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247826,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":394602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45312,"internal_metadata":27545344},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":395986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49734,"internal_metadata":27540922},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607572,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47647,"internal_metadata":27543009},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9192,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8946,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17796,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6310,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5193,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6276,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20535,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9881,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14668,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12820,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-19T21:04:39.927 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-19T21:04:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:39 trial175 ceph-mon[34116]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:39 trial175 ceph-mon[34116]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:39 trial175 ceph-mon[34116]: pgmap v179: 97 pgs: 97 active+clean; 604 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2026-02-19T21:04:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2855889128' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:40.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/472684712' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:40.083 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:40.104 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:39 trial090 ceph-mon[31759]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:40.104 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:39 trial090 ceph-mon[31759]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:40.104 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:39 trial090 ceph-mon[31759]: pgmap v179: 97 pgs: 97 active+clean; 604 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2026-02-19T21:04:40.104 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2855889128' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:40.104 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/472684712' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:39 trial105 ceph-mon[33883]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:39 trial105 ceph-mon[33883]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-19T21:04:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:39 trial105 ceph-mon[33883]: pgmap v179: 97 pgs: 97 active+clean; 604 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2026-02-19T21:04:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2855889128' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-19T21:04:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/472684712' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:40.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/181737172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c64114150 msgr2=0x7f1c64119100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/181737172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c64114150 0x7f1c64119100 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=6314257187182057293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c54009970 tx=0x7f1c5402ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:40.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/181737172 shutdown_connections 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/181737172 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c641198b0 0x7f1c6417a280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/181737172 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c64114150 0x7f1c64119100 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=6314257187182057293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/181737172 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c64113760 0x7f1c64113b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/181737172 >> 10.20.193.90:0/181737172 conn(0x7f1c64060720 msgr2=0x7f1c64060cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/181737172 shutdown_connections 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/181737172 wait complete. 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 Processor -- start 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.196+0000 7f1c6a6846c0 1 -- start start 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c64113760 0x7f1c64121780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 0x7f1c64121cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c64127030 0x7f1c641274d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1c64127a10 con 0x7f1c641198b0 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1c64127b80 con 0x7f1c64127030 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1c64127d40 con 0x7f1c64113760 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 0x7f1c64121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 0x7f1c64121cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43510/0 (socket says 10.20.193.90:43510) 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 -- 10.20.193.90:0/1772532276 learned_addr learned my addr 10.20.193.90:0/1772532276 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c63fff6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c64113760 0x7f1c64121780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c68bfa6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c64127030 0x7f1c641274d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 -- 10.20.193.90:0/1772532276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c64113760 msgr2=0x7f1c64121780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c64113760 0x7f1c64121780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 -- 10.20.193.90:0/1772532276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c64127030 msgr2=0x7f1c641274d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c64127030 0x7f1c641274d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 -- 10.20.193.90:0/1772532276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c54009590 con 0x7f1c641198b0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c637fe6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 0x7f1c64121cc0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c54009290 tx=0x7f1c5402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c54002ae0 con 0x7f1c641198b0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1c54002c40 con 0x7f1c641198b0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c641681c0 con 0x7f1c641198b0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c540372f0 con 0x7f1c641198b0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c64168640 con 0x7f1c641198b0 2026-02-19T21:04:40.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.197+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c641149a0 con 0x7f1c641198b0 2026-02-19T21:04:40.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.199+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f1c540071c0 con 0x7f1c641198b0 2026-02-19T21:04:40.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.199+0000 7f1c617fa6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1c380b56e0 0x7f1c380d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.199+0000 7f1c63fff6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1c380b56e0 0x7f1c380d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.199+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f1c54107fa0 con 0x7f1c641198b0 2026-02-19T21:04:40.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.200+0000 7f1c63fff6c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1c380b56e0 0x7f1c380d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c50005980 tx=0x7f1c50005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:40.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.200+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1c540ca930 con 0x7f1c641198b0 2026-02-19T21:04:40.293 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.291+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c64122880 con 0x7f1c380b56e0 2026-02-19T21:04:40.295 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.294+0000 7f1c617fa6c0 1 -- 10.20.193.90:0/1772532276 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258769 (secure 0 0 0) 0x7f1c64122880 con 0x7f1c380b56e0 2026-02-19T21:04:40.296 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:40.297 INFO:teuthology.orchestra.run.trial090.stderr:dumped all 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.295+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1c380b56e0 msgr2=0x7f1c380d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.295+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1c380b56e0 0x7f1c380d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c50005980 tx=0x7f1c50005910 comp rx=0 tx=0).stop 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.295+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 msgr2=0x7f1c64121cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.295+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 0x7f1c64121cc0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c54009290 tx=0x7f1c5402fbf0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 shutdown_connections 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1c380b56e0 0x7f1c380d5b90 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1c64127030 0x7f1c641274d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1c641198b0 0x7f1c64121cc0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 --2- 10.20.193.90:0/1772532276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1c64113760 0x7f1c64121780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 >> 10.20.193.90:0/1772532276 conn(0x7f1c64060720 msgr2=0x7f1c64117f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 shutdown_connections 2026-02-19T21:04:40.298 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.296+0000 7f1c6a6846c0 1 -- 10.20.193.90:0/1772532276 wait complete. 2026-02-19T21:04:40.335 INFO:teuthology.orchestra.run.trial090.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2026-02-19T21:04:38.878714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":618529,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":137,"num_write":306,"num_write_kb":3776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":260,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335004,"kb_used_data":11436,"kb_used_omap":362,"kb_used_meta":322965,"kb_avail":8807703396,"statfs":{"total":9019431321600,"available":9019088277504,"internally_reserved":0,"allocated":11710464,"data_stored":6521726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":370790,"internal_metadata":330717082},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28161,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":17,"num_read_kb":38,"num_write":117,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001438"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306620+0000","last_change":"2026-02-19T21:04:31.287002+0000","last_active":"2026-02-19T21:04:32.306620+0000","last_peered":"2026-02-19T21:04:32.306620+0000","last_clean":"2026-02-19T21:04:32.306620+0000","last_became_active":"2026-02-19T21:04:31.286342+0000","last_became_peered":"2026-02-19T21:04:31.286342+0000","last_unstale":"2026-02-19T21:04:32.306620+0000","last_undegraded":"2026-02-19T21:04:32.306620+0000","last_fullsized":"2026-02-19T21:04:32.306620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:10:00.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304824+0000","last_change":"2026-02-19T21:04:31.285136+0000","last_active":"2026-02-19T21:04:32.304824+0000","last_peered":"2026-02-19T21:04:32.304824+0000","last_clean":"2026-02-19T21:04:32.304824+0000","last_became_active":"2026-02-19T21:04:31.284945+0000","last_became_peered":"2026-02-19T21:04:31.284945+0000","last_unstale":"2026-02-19T21:04:32.304824+0000","last_undegraded":"2026-02-19T21:04:32.304824+0000","last_fullsized":"2026-02-19T21:04:32.304824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:08:07.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304888+0000","last_change":"2026-02-19T21:04:31.286791+0000","last_active":"2026-02-19T21:04:32.304888+0000","last_peered":"2026-02-19T21:04:32.304888+0000","last_clean":"2026-02-19T21:04:32.304888+0000","last_became_active":"2026-02-19T21:04:31.286150+0000","last_became_peered":"2026-02-19T21:04:31.286150+0000","last_unstale":"2026-02-19T21:04:32.304888+0000","last_undegraded":"2026-02-19T21:04:32.304888+0000","last_fullsized":"2026-02-19T21:04:32.304888+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:29:44.208057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306002+0000","last_change":"2026-02-19T21:04:31.287914+0000","last_active":"2026-02-19T21:04:32.306002+0000","last_peered":"2026-02-19T21:04:32.306002+0000","last_clean":"2026-02-19T21:04:32.306002+0000","last_became_active":"2026-02-19T21:04:31.287376+0000","last_became_peered":"2026-02-19T21:04:31.287376+0000","last_unstale":"2026-02-19T21:04:32.306002+0000","last_undegraded":"2026-02-19T21:04:32.306002+0000","last_fullsized":"2026-02-19T21:04:32.306002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:27:40.549645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282804+0000","last_change":"2026-02-19T21:04:31.286299+0000","last_active":"2026-02-19T21:04:32.282804+0000","last_peered":"2026-02-19T21:04:32.282804+0000","last_clean":"2026-02-19T21:04:32.282804+0000","last_became_active":"2026-02-19T21:04:31.285600+0000","last_became_peered":"2026-02-19T21:04:31.285600+0000","last_unstale":"2026-02-19T21:04:32.282804+0000","last_undegraded":"2026-02-19T21:04:32.282804+0000","last_fullsized":"2026-02-19T21:04:32.282804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:26:00.465870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282241+0000","last_change":"2026-02-19T21:04:31.285609+0000","last_active":"2026-02-19T21:04:32.282241+0000","last_peered":"2026-02-19T21:04:32.282241+0000","last_clean":"2026-02-19T21:04:32.282241+0000","last_became_active":"2026-02-19T21:04:31.285465+0000","last_became_peered":"2026-02-19T21:04:31.285465+0000","last_unstale":"2026-02-19T21:04:32.282241+0000","last_undegraded":"2026-02-19T21:04:32.282241+0000","last_fullsized":"2026-02-19T21:04:32.282241+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:10.356903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440798+0000","last_change":"2026-02-19T21:04:31.287193+0000","last_active":"2026-02-19T21:04:32.440798+0000","last_peered":"2026-02-19T21:04:32.440798+0000","last_clean":"2026-02-19T21:04:32.440798+0000","last_became_active":"2026-02-19T21:04:31.286850+0000","last_became_peered":"2026-02-19T21:04:31.286850+0000","last_unstale":"2026-02-19T21:04:32.440798+0000","last_undegraded":"2026-02-19T21:04:32.440798+0000","last_fullsized":"2026-02-19T21:04:32.440798+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:50.866916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304740+0000","last_change":"2026-02-19T21:04:31.287351+0000","last_active":"2026-02-19T21:04:32.304740+0000","last_peered":"2026-02-19T21:04:32.304740+0000","last_clean":"2026-02-19T21:04:32.304740+0000","last_became_active":"2026-02-19T21:04:31.287147+0000","last_became_peered":"2026-02-19T21:04:31.287147+0000","last_unstale":"2026-02-19T21:04:32.304740+0000","last_undegraded":"2026-02-19T21:04:32.304740+0000","last_fullsized":"2026-02-19T21:04:32.304740+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:58:45.877506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305201+0000","last_change":"2026-02-19T21:04:31.288496+0000","last_active":"2026-02-19T21:04:32.305201+0000","last_peered":"2026-02-19T21:04:32.305201+0000","last_clean":"2026-02-19T21:04:32.305201+0000","last_became_active":"2026-02-19T21:04:31.288194+0000","last_became_peered":"2026-02-19T21:04:31.288194+0000","last_unstale":"2026-02-19T21:04:32.305201+0000","last_undegraded":"2026-02-19T21:04:32.305201+0000","last_fullsized":"2026-02-19T21:04:32.305201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:00:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282691+0000","last_change":"2026-02-19T21:04:31.288303+0000","last_active":"2026-02-19T21:04:32.282691+0000","last_peered":"2026-02-19T21:04:32.282691+0000","last_clean":"2026-02-19T21:04:32.282691+0000","last_became_active":"2026-02-19T21:04:31.288160+0000","last_became_peered":"2026-02-19T21:04:31.288160+0000","last_unstale":"2026-02-19T21:04:32.282691+0000","last_undegraded":"2026-02-19T21:04:32.282691+0000","last_fullsized":"2026-02-19T21:04:32.282691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:47:29.467905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441339+0000","last_change":"2026-02-19T21:04:31.287633+0000","last_active":"2026-02-19T21:04:32.441339+0000","last_peered":"2026-02-19T21:04:32.441339+0000","last_clean":"2026-02-19T21:04:32.441339+0000","last_became_active":"2026-02-19T21:04:31.287434+0000","last_became_peered":"2026-02-19T21:04:31.287434+0000","last_unstale":"2026-02-19T21:04:32.441339+0000","last_undegraded":"2026-02-19T21:04:32.441339+0000","last_fullsized":"2026-02-19T21:04:32.441339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:34:20.533516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305980+0000","last_change":"2026-02-19T21:04:31.288404+0000","last_active":"2026-02-19T21:04:32.305980+0000","last_peered":"2026-02-19T21:04:32.305980+0000","last_clean":"2026-02-19T21:04:32.305980+0000","last_became_active":"2026-02-19T21:04:31.287620+0000","last_became_peered":"2026-02-19T21:04:31.287620+0000","last_unstale":"2026-02-19T21:04:32.305980+0000","last_undegraded":"2026-02-19T21:04:32.305980+0000","last_fullsized":"2026-02-19T21:04:32.305980+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:25.760231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304889+0000","last_change":"2026-02-19T21:04:31.285595+0000","last_active":"2026-02-19T21:04:32.304889+0000","last_peered":"2026-02-19T21:04:32.304889+0000","last_clean":"2026-02-19T21:04:32.304889+0000","last_became_active":"2026-02-19T21:04:31.285372+0000","last_became_peered":"2026-02-19T21:04:31.285372+0000","last_unstale":"2026-02-19T21:04:32.304889+0000","last_undegraded":"2026-02-19T21:04:32.304889+0000","last_fullsized":"2026-02-19T21:04:32.304889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:35.546455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304606+0000","last_change":"2026-02-19T21:04:31.284499+0000","last_active":"2026-02-19T21:04:32.304606+0000","last_peered":"2026-02-19T21:04:32.304606+0000","last_clean":"2026-02-19T21:04:32.304606+0000","last_became_active":"2026-02-19T21:04:31.284262+0000","last_became_peered":"2026-02-19T21:04:31.284262+0000","last_unstale":"2026-02-19T21:04:32.304606+0000","last_undegraded":"2026-02-19T21:04:32.304606+0000","last_fullsized":"2026-02-19T21:04:32.304606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:48:14.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304506+0000","last_change":"2026-02-19T21:04:31.287280+0000","last_active":"2026-02-19T21:04:32.304506+0000","last_peered":"2026-02-19T21:04:32.304506+0000","last_clean":"2026-02-19T21:04:32.304506+0000","last_became_active":"2026-02-19T21:04:31.287026+0000","last_became_peered":"2026-02-19T21:04:31.287026+0000","last_unstale":"2026-02-19T21:04:32.304506+0000","last_undegraded":"2026-02-19T21:04:32.304506+0000","last_fullsized":"2026-02-19T21:04:32.304506+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:15:11.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304856+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:32.304856+0000","last_peered":"2026-02-19T21:04:32.304856+0000","last_clean":"2026-02-19T21:04:32.304856+0000","last_became_active":"2026-02-19T21:04:31.286591+0000","last_became_peered":"2026-02-19T21:04:31.286591+0000","last_unstale":"2026-02-19T21:04:32.304856+0000","last_undegraded":"2026-02-19T21:04:32.304856+0000","last_fullsized":"2026-02-19T21:04:32.304856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:24:52.717294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306791+0000","last_change":"2026-02-19T21:04:31.287192+0000","last_active":"2026-02-19T21:04:32.306791+0000","last_peered":"2026-02-19T21:04:32.306791+0000","last_clean":"2026-02-19T21:04:32.306791+0000","last_became_active":"2026-02-19T21:04:31.287005+0000","last_became_peered":"2026-02-19T21:04:31.287005+0000","last_unstale":"2026-02-19T21:04:32.306791+0000","last_undegraded":"2026-02-19T21:04:32.306791+0000","last_fullsized":"2026-02-19T21:04:32.306791+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:18.523767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.281063+0000","last_change":"2026-02-19T21:04:31.285298+0000","last_active":"2026-02-19T21:04:32.281063+0000","last_peered":"2026-02-19T21:04:32.281063+0000","last_clean":"2026-02-19T21:04:32.281063+0000","last_became_active":"2026-02-19T21:04:31.285047+0000","last_became_peered":"2026-02-19T21:04:31.285047+0000","last_unstale":"2026-02-19T21:04:32.281063+0000","last_undegraded":"2026-02-19T21:04:32.281063+0000","last_fullsized":"2026-02-19T21:04:32.281063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:32:45.124589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306260+0000","last_change":"2026-02-19T21:04:31.287399+0000","last_active":"2026-02-19T21:04:32.306260+0000","last_peered":"2026-02-19T21:04:32.306260+0000","last_clean":"2026-02-19T21:04:32.306260+0000","last_became_active":"2026-02-19T21:04:31.286835+0000","last_became_peered":"2026-02-19T21:04:31.286835+0000","last_unstale":"2026-02-19T21:04:32.306260+0000","last_undegraded":"2026-02-19T21:04:32.306260+0000","last_fullsized":"2026-02-19T21:04:32.306260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:16.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306360+0000","last_change":"2026-02-19T21:04:31.288156+0000","last_active":"2026-02-19T21:04:32.306360+0000","last_peered":"2026-02-19T21:04:32.306360+0000","last_clean":"2026-02-19T21:04:32.306360+0000","last_became_active":"2026-02-19T21:04:31.288012+0000","last_became_peered":"2026-02-19T21:04:31.288012+0000","last_unstale":"2026-02-19T21:04:32.306360+0000","last_undegraded":"2026-02-19T21:04:32.306360+0000","last_fullsized":"2026-02-19T21:04:32.306360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:05:48.712920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305037+0000","last_change":"2026-02-19T21:04:31.285690+0000","last_active":"2026-02-19T21:04:32.305037+0000","last_peered":"2026-02-19T21:04:32.305037+0000","last_clean":"2026-02-19T21:04:32.305037+0000","last_became_active":"2026-02-19T21:04:31.285498+0000","last_became_peered":"2026-02-19T21:04:31.285498+0000","last_unstale":"2026-02-19T21:04:32.305037+0000","last_undegraded":"2026-02-19T21:04:32.305037+0000","last_fullsized":"2026-02-19T21:04:32.305037+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:48:40.789834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304918+0000","last_change":"2026-02-19T21:04:31.288360+0000","last_active":"2026-02-19T21:04:32.304918+0000","last_peered":"2026-02-19T21:04:32.304918+0000","last_clean":"2026-02-19T21:04:32.304918+0000","last_became_active":"2026-02-19T21:04:31.287849+0000","last_became_peered":"2026-02-19T21:04:31.287849+0000","last_unstale":"2026-02-19T21:04:32.304918+0000","last_undegraded":"2026-02-19T21:04:32.304918+0000","last_fullsized":"2026-02-19T21:04:32.304918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:24:06.399904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304776+0000","last_change":"2026-02-19T21:04:31.286420+0000","last_active":"2026-02-19T21:04:32.304776+0000","last_peered":"2026-02-19T21:04:32.304776+0000","last_clean":"2026-02-19T21:04:32.304776+0000","last_became_active":"2026-02-19T21:04:31.285905+0000","last_became_peered":"2026-02-19T21:04:31.285905+0000","last_unstale":"2026-02-19T21:04:32.304776+0000","last_undegraded":"2026-02-19T21:04:32.304776+0000","last_fullsized":"2026-02-19T21:04:32.304776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:07:02.537538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306236+0000","last_change":"2026-02-19T21:04:31.288706+0000","last_active":"2026-02-19T21:04:32.306236+0000","last_peered":"2026-02-19T21:04:32.306236+0000","last_clean":"2026-02-19T21:04:32.306236+0000","last_became_active":"2026-02-19T21:04:31.287837+0000","last_became_peered":"2026-02-19T21:04:31.287837+0000","last_unstale":"2026-02-19T21:04:32.306236+0000","last_undegraded":"2026-02-19T21:04:32.306236+0000","last_fullsized":"2026-02-19T21:04:32.306236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:33:01.082715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305204+0000","last_change":"2026-02-19T21:04:31.286807+0000","last_active":"2026-02-19T21:04:32.305204+0000","last_peered":"2026-02-19T21:04:32.305204+0000","last_clean":"2026-02-19T21:04:32.305204+0000","last_became_active":"2026-02-19T21:04:31.286555+0000","last_became_peered":"2026-02-19T21:04:31.286555+0000","last_unstale":"2026-02-19T21:04:32.305204+0000","last_undegraded":"2026-02-19T21:04:32.305204+0000","last_fullsized":"2026-02-19T21:04:32.305204+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:33.064392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306361+0000","last_change":"2026-02-19T21:04:31.288135+0000","last_active":"2026-02-19T21:04:32.306361+0000","last_peered":"2026-02-19T21:04:32.306361+0000","last_clean":"2026-02-19T21:04:32.306361+0000","last_became_active":"2026-02-19T21:04:31.287889+0000","last_became_peered":"2026-02-19T21:04:31.287889+0000","last_unstale":"2026-02-19T21:04:32.306361+0000","last_undegraded":"2026-02-19T21:04:32.306361+0000","last_fullsized":"2026-02-19T21:04:32.306361+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:41:33.753704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306523+0000","last_change":"2026-02-19T21:04:31.286954+0000","last_active":"2026-02-19T21:04:32.306523+0000","last_peered":"2026-02-19T21:04:32.306523+0000","last_clean":"2026-02-19T21:04:32.306523+0000","last_became_active":"2026-02-19T21:04:31.286509+0000","last_became_peered":"2026-02-19T21:04:31.286509+0000","last_unstale":"2026-02-19T21:04:32.306523+0000","last_undegraded":"2026-02-19T21:04:32.306523+0000","last_fullsized":"2026-02-19T21:04:32.306523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:03.051404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305010+0000","last_change":"2026-02-19T21:04:31.288452+0000","last_active":"2026-02-19T21:04:32.305010+0000","last_peered":"2026-02-19T21:04:32.305010+0000","last_clean":"2026-02-19T21:04:32.305010+0000","last_became_active":"2026-02-19T21:04:31.288288+0000","last_became_peered":"2026-02-19T21:04:31.288288+0000","last_unstale":"2026-02-19T21:04:32.305010+0000","last_undegraded":"2026-02-19T21:04:32.305010+0000","last_fullsized":"2026-02-19T21:04:32.305010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:36:20.116850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304875+0000","last_change":"2026-02-19T21:04:31.287437+0000","last_active":"2026-02-19T21:04:32.304875+0000","last_peered":"2026-02-19T21:04:32.304875+0000","last_clean":"2026-02-19T21:04:32.304875+0000","last_became_active":"2026-02-19T21:04:31.287292+0000","last_became_peered":"2026-02-19T21:04:31.287292+0000","last_unstale":"2026-02-19T21:04:32.304875+0000","last_undegraded":"2026-02-19T21:04:32.304875+0000","last_fullsized":"2026-02-19T21:04:32.304875+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:27.235359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305871+0000","last_change":"2026-02-19T21:04:31.286030+0000","last_active":"2026-02-19T21:04:32.305871+0000","last_peered":"2026-02-19T21:04:32.305871+0000","last_clean":"2026-02-19T21:04:32.305871+0000","last_became_active":"2026-02-19T21:04:31.285556+0000","last_became_peered":"2026-02-19T21:04:31.285556+0000","last_unstale":"2026-02-19T21:04:32.305871+0000","last_undegraded":"2026-02-19T21:04:32.305871+0000","last_fullsized":"2026-02-19T21:04:32.305871+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:09:01.348835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305872+0000","last_change":"2026-02-19T21:04:31.289211+0000","last_active":"2026-02-19T21:04:32.305872+0000","last_peered":"2026-02-19T21:04:32.305872+0000","last_clean":"2026-02-19T21:04:32.305872+0000","last_became_active":"2026-02-19T21:04:31.288961+0000","last_became_peered":"2026-02-19T21:04:31.288961+0000","last_unstale":"2026-02-19T21:04:32.305872+0000","last_undegraded":"2026-02-19T21:04:32.305872+0000","last_fullsized":"2026-02-19T21:04:32.305872+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:03:11.179940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306191+0000","last_change":"2026-02-19T21:04:31.288628+0000","last_active":"2026-02-19T21:04:32.306191+0000","last_peered":"2026-02-19T21:04:32.306191+0000","last_clean":"2026-02-19T21:04:32.306191+0000","last_became_active":"2026-02-19T21:04:31.288458+0000","last_became_peered":"2026-02-19T21:04:31.288458+0000","last_unstale":"2026-02-19T21:04:32.306191+0000","last_undegraded":"2026-02-19T21:04:32.306191+0000","last_fullsized":"2026-02-19T21:04:32.306191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:24:59.338008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282712+0000","last_change":"2026-02-19T21:04:31.287078+0000","last_active":"2026-02-19T21:04:32.282712+0000","last_peered":"2026-02-19T21:04:32.282712+0000","last_clean":"2026-02-19T21:04:32.282712+0000","last_became_active":"2026-02-19T21:04:31.286730+0000","last_became_peered":"2026-02-19T21:04:31.286730+0000","last_unstale":"2026-02-19T21:04:32.282712+0000","last_undegraded":"2026-02-19T21:04:32.282712+0000","last_fullsized":"2026-02-19T21:04:32.282712+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:52:57.154998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'5","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719502+0000","last_change":"2026-02-19T21:04:30.410537+0000","last_active":"2026-02-19T21:04:34.719502+0000","last_peered":"2026-02-19T21:04:34.719502+0000","last_clean":"2026-02-19T21:04:34.719502+0000","last_became_active":"2026-02-19T21:04:30.410253+0000","last_became_peered":"2026-02-19T21:04:30.410253+0000","last_unstale":"2026-02-19T21:04:34.719502+0000","last_undegraded":"2026-02-19T21:04:34.719502+0000","last_fullsized":"2026-02-19T21:04:34.719502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:43:09.872775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306558+0000","last_change":"2026-02-19T21:04:31.289847+0000","last_active":"2026-02-19T21:04:32.306558+0000","last_peered":"2026-02-19T21:04:32.306558+0000","last_clean":"2026-02-19T21:04:32.306558+0000","last_became_active":"2026-02-19T21:04:31.289674+0000","last_became_peered":"2026-02-19T21:04:31.289674+0000","last_unstale":"2026-02-19T21:04:32.306558+0000","last_undegraded":"2026-02-19T21:04:32.306558+0000","last_fullsized":"2026-02-19T21:04:32.306558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:19:57.744963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.724781+0000","last_change":"2026-02-19T21:04:30.411183+0000","last_active":"2026-02-19T21:04:35.724781+0000","last_peered":"2026-02-19T21:04:35.724781+0000","last_clean":"2026-02-19T21:04:35.724781+0000","last_became_active":"2026-02-19T21:04:30.410927+0000","last_became_peered":"2026-02-19T21:04:30.410927+0000","last_unstale":"2026-02-19T21:04:35.724781+0000","last_undegraded":"2026-02-19T21:04:35.724781+0000","last_fullsized":"2026-02-19T21:04:35.724781+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:27:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.724614+0000","last_change":"2026-02-19T21:04:30.407656+0000","last_active":"2026-02-19T21:04:35.724614+0000","last_peered":"2026-02-19T21:04:35.724614+0000","last_clean":"2026-02-19T21:04:35.724614+0000","last_became_active":"2026-02-19T21:04:30.407355+0000","last_became_peered":"2026-02-19T21:04:30.407355+0000","last_unstale":"2026-02-19T21:04:35.724614+0000","last_undegraded":"2026-02-19T21:04:35.724614+0000","last_fullsized":"2026-02-19T21:04:35.724614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:45:24.893068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304795+0000","last_change":"2026-02-19T21:04:31.282577+0000","last_active":"2026-02-19T21:04:32.304795+0000","last_peered":"2026-02-19T21:04:32.304795+0000","last_clean":"2026-02-19T21:04:32.304795+0000","last_became_active":"2026-02-19T21:04:31.282337+0000","last_became_peered":"2026-02-19T21:04:31.282337+0000","last_unstale":"2026-02-19T21:04:32.304795+0000","last_undegraded":"2026-02-19T21:04:32.304795+0000","last_fullsized":"2026-02-19T21:04:32.304795+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:16:10.971557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306615+0000","last_change":"2026-02-19T21:04:30.409768+0000","last_active":"2026-02-19T21:04:32.306615+0000","last_peered":"2026-02-19T21:04:32.306615+0000","last_clean":"2026-02-19T21:04:32.306615+0000","last_became_active":"2026-02-19T21:04:30.409536+0000","last_became_peered":"2026-02-19T21:04:30.409536+0000","last_unstale":"2026-02-19T21:04:32.306615+0000","last_undegraded":"2026-02-19T21:04:32.306615+0000","last_fullsized":"2026-02-19T21:04:32.306615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:59.805182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.280885+0000","last_change":"2026-02-19T21:04:31.284256+0000","last_active":"2026-02-19T21:04:32.280885+0000","last_peered":"2026-02-19T21:04:32.280885+0000","last_clean":"2026-02-19T21:04:32.280885+0000","last_became_active":"2026-02-19T21:04:31.284072+0000","last_became_peered":"2026-02-19T21:04:31.284072+0000","last_unstale":"2026-02-19T21:04:32.280885+0000","last_undegraded":"2026-02-19T21:04:32.280885+0000","last_fullsized":"2026-02-19T21:04:32.280885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:06:45.684098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:36.728545+0000","last_change":"2026-02-19T21:04:30.411605+0000","last_active":"2026-02-19T21:04:36.728545+0000","last_peered":"2026-02-19T21:04:36.728545+0000","last_clean":"2026-02-19T21:04:36.728545+0000","last_became_active":"2026-02-19T21:04:30.411457+0000","last_became_peered":"2026-02-19T21:04:30.411457+0000","last_unstale":"2026-02-19T21:04:36.728545+0000","last_undegraded":"2026-02-19T21:04:36.728545+0000","last_fullsized":"2026-02-19T21:04:36.728545+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:03:03.301109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305185+0000","last_change":"2026-02-19T21:04:31.286695+0000","last_active":"2026-02-19T21:04:32.305185+0000","last_peered":"2026-02-19T21:04:32.305185+0000","last_clean":"2026-02-19T21:04:32.305185+0000","last_became_active":"2026-02-19T21:04:31.286522+0000","last_became_peered":"2026-02-19T21:04:31.286522+0000","last_unstale":"2026-02-19T21:04:32.305185+0000","last_undegraded":"2026-02-19T21:04:32.305185+0000","last_fullsized":"2026-02-19T21:04:32.305185+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:49:26.698378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718027+0000","last_change":"2026-02-19T21:04:30.409642+0000","last_active":"2026-02-19T21:04:34.718027+0000","last_peered":"2026-02-19T21:04:34.718027+0000","last_clean":"2026-02-19T21:04:34.718027+0000","last_became_active":"2026-02-19T21:04:30.409369+0000","last_became_peered":"2026-02-19T21:04:30.409369+0000","last_unstale":"2026-02-19T21:04:34.718027+0000","last_undegraded":"2026-02-19T21:04:34.718027+0000","last_fullsized":"2026-02-19T21:04:34.718027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:42:09.905781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304917+0000","last_change":"2026-02-19T21:04:31.287134+0000","last_active":"2026-02-19T21:04:32.304917+0000","last_peered":"2026-02-19T21:04:32.304917+0000","last_clean":"2026-02-19T21:04:32.304917+0000","last_became_active":"2026-02-19T21:04:31.286957+0000","last_became_peered":"2026-02-19T21:04:31.286957+0000","last_unstale":"2026-02-19T21:04:32.304917+0000","last_undegraded":"2026-02-19T21:04:32.304917+0000","last_fullsized":"2026-02-19T21:04:32.304917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:20:14.188668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306690+0000","last_change":"2026-02-19T21:04:30.410806+0000","last_active":"2026-02-19T21:04:32.306690+0000","last_peered":"2026-02-19T21:04:32.306690+0000","last_clean":"2026-02-19T21:04:32.306690+0000","last_became_active":"2026-02-19T21:04:30.410547+0000","last_became_peered":"2026-02-19T21:04:30.410547+0000","last_unstale":"2026-02-19T21:04:32.306690+0000","last_undegraded":"2026-02-19T21:04:32.306690+0000","last_fullsized":"2026-02-19T21:04:32.306690+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:43:04.471874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305070+0000","last_change":"2026-02-19T21:04:31.288726+0000","last_active":"2026-02-19T21:04:32.305070+0000","last_peered":"2026-02-19T21:04:32.305070+0000","last_clean":"2026-02-19T21:04:32.305070+0000","last_became_active":"2026-02-19T21:04:31.288355+0000","last_became_peered":"2026-02-19T21:04:31.288355+0000","last_unstale":"2026-02-19T21:04:32.305070+0000","last_undegraded":"2026-02-19T21:04:32.305070+0000","last_fullsized":"2026-02-19T21:04:32.305070+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:23:35.206511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'16","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:37.730808+0000","last_change":"2026-02-19T21:04:30.411062+0000","last_active":"2026-02-19T21:04:37.730808+0000","last_peered":"2026-02-19T21:04:37.730808+0000","last_clean":"2026-02-19T21:04:37.730808+0000","last_became_active":"2026-02-19T21:04:30.410903+0000","last_became_peered":"2026-02-19T21:04:30.410903+0000","last_unstale":"2026-02-19T21:04:37.730808+0000","last_undegraded":"2026-02-19T21:04:37.730808+0000","last_fullsized":"2026-02-19T21:04:37.730808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:54:52.679727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25594,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":28,"num_write":17,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282933+0000","last_change":"2026-02-19T21:04:31.287063+0000","last_active":"2026-02-19T21:04:32.282933+0000","last_peered":"2026-02-19T21:04:32.282933+0000","last_clean":"2026-02-19T21:04:32.282933+0000","last_became_active":"2026-02-19T21:04:31.286765+0000","last_became_peered":"2026-02-19T21:04:31.286765+0000","last_unstale":"2026-02-19T21:04:32.282933+0000","last_undegraded":"2026-02-19T21:04:32.282933+0000","last_fullsized":"2026-02-19T21:04:32.282933+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:15:56.935874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719108+0000","last_change":"2026-02-19T21:04:30.411559+0000","last_active":"2026-02-19T21:04:34.719108+0000","last_peered":"2026-02-19T21:04:34.719108+0000","last_clean":"2026-02-19T21:04:34.719108+0000","last_became_active":"2026-02-19T21:04:30.411317+0000","last_became_peered":"2026-02-19T21:04:30.411317+0000","last_unstale":"2026-02-19T21:04:34.719108+0000","last_undegraded":"2026-02-19T21:04:34.719108+0000","last_fullsized":"2026-02-19T21:04:34.719108+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:55.609906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304856+0000","last_change":"2026-02-19T21:04:31.286692+0000","last_active":"2026-02-19T21:04:32.304856+0000","last_peered":"2026-02-19T21:04:32.304856+0000","last_clean":"2026-02-19T21:04:32.304856+0000","last_became_active":"2026-02-19T21:04:31.286343+0000","last_became_peered":"2026-02-19T21:04:31.286343+0000","last_unstale":"2026-02-19T21:04:32.304856+0000","last_undegraded":"2026-02-19T21:04:32.304856+0000","last_fullsized":"2026-02-19T21:04:32.304856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:34:53.155015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719388+0000","last_change":"2026-02-19T21:04:30.409868+0000","last_active":"2026-02-19T21:04:34.719388+0000","last_peered":"2026-02-19T21:04:34.719388+0000","last_clean":"2026-02-19T21:04:34.719388+0000","last_became_active":"2026-02-19T21:04:30.409568+0000","last_became_peered":"2026-02-19T21:04:30.409568+0000","last_unstale":"2026-02-19T21:04:34.719388+0000","last_undegraded":"2026-02-19T21:04:34.719388+0000","last_fullsized":"2026-02-19T21:04:34.719388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:45:25.596378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441222+0000","last_change":"2026-02-19T21:04:31.288696+0000","last_active":"2026-02-19T21:04:32.441222+0000","last_peered":"2026-02-19T21:04:32.441222+0000","last_clean":"2026-02-19T21:04:32.441222+0000","last_became_active":"2026-02-19T21:04:31.288460+0000","last_became_peered":"2026-02-19T21:04:31.288460+0000","last_unstale":"2026-02-19T21:04:32.441222+0000","last_undegraded":"2026-02-19T21:04:32.441222+0000","last_fullsized":"2026-02-19T21:04:32.441222+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:02.502851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305595+0000","last_change":"2026-02-19T21:04:30.409894+0000","last_active":"2026-02-19T21:04:32.305595+0000","last_peered":"2026-02-19T21:04:32.305595+0000","last_clean":"2026-02-19T21:04:32.305595+0000","last_became_active":"2026-02-19T21:04:30.409694+0000","last_became_peered":"2026-02-19T21:04:30.409694+0000","last_unstale":"2026-02-19T21:04:32.305595+0000","last_undegraded":"2026-02-19T21:04:32.305595+0000","last_fullsized":"2026-02-19T21:04:32.305595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:44:08.909989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440800+0000","last_change":"2026-02-19T21:04:31.289106+0000","last_active":"2026-02-19T21:04:32.440800+0000","last_peered":"2026-02-19T21:04:32.440800+0000","last_clean":"2026-02-19T21:04:32.440800+0000","last_became_active":"2026-02-19T21:04:31.288889+0000","last_became_peered":"2026-02-19T21:04:31.288889+0000","last_unstale":"2026-02-19T21:04:32.440800+0000","last_undegraded":"2026-02-19T21:04:32.440800+0000","last_fullsized":"2026-02-19T21:04:32.440800+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:56:11.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.726783+0000","last_change":"2026-02-19T21:04:30.409277+0000","last_active":"2026-02-19T21:04:35.726783+0000","last_peered":"2026-02-19T21:04:35.726783+0000","last_clean":"2026-02-19T21:04:35.726783+0000","last_became_active":"2026-02-19T21:04:30.409098+0000","last_became_peered":"2026-02-19T21:04:30.409098+0000","last_unstale":"2026-02-19T21:04:35.726783+0000","last_undegraded":"2026-02-19T21:04:35.726783+0000","last_fullsized":"2026-02-19T21:04:35.726783+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:09:56.289622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306412+0000","last_change":"2026-02-19T21:04:31.289313+0000","last_active":"2026-02-19T21:04:32.306412+0000","last_peered":"2026-02-19T21:04:32.306412+0000","last_clean":"2026-02-19T21:04:32.306412+0000","last_became_active":"2026-02-19T21:04:31.288983+0000","last_became_peered":"2026-02-19T21:04:31.288983+0000","last_unstale":"2026-02-19T21:04:32.306412+0000","last_undegraded":"2026-02-19T21:04:32.306412+0000","last_fullsized":"2026-02-19T21:04:32.306412+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:56.535103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:36.723692+0000","last_change":"2026-02-19T21:04:30.411049+0000","last_active":"2026-02-19T21:04:36.723692+0000","last_peered":"2026-02-19T21:04:36.723692+0000","last_clean":"2026-02-19T21:04:36.723692+0000","last_became_active":"2026-02-19T21:04:30.410550+0000","last_became_peered":"2026-02-19T21:04:30.410550+0000","last_unstale":"2026-02-19T21:04:36.723692+0000","last_undegraded":"2026-02-19T21:04:36.723692+0000","last_fullsized":"2026-02-19T21:04:36.723692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:08:50.397444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306487+0000","last_change":"2026-02-19T21:04:31.288124+0000","last_active":"2026-02-19T21:04:32.306487+0000","last_peered":"2026-02-19T21:04:32.306487+0000","last_clean":"2026-02-19T21:04:32.306487+0000","last_became_active":"2026-02-19T21:04:31.287990+0000","last_became_peered":"2026-02-19T21:04:31.287990+0000","last_unstale":"2026-02-19T21:04:32.306487+0000","last_undegraded":"2026-02-19T21:04:32.306487+0000","last_fullsized":"2026-02-19T21:04:32.306487+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:27:38.346349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304912+0000","last_change":"2026-02-19T21:04:30.407979+0000","last_active":"2026-02-19T21:04:32.304912+0000","last_peered":"2026-02-19T21:04:32.304912+0000","last_clean":"2026-02-19T21:04:32.304912+0000","last_became_active":"2026-02-19T21:04:30.407755+0000","last_became_peered":"2026-02-19T21:04:30.407755+0000","last_unstale":"2026-02-19T21:04:32.304912+0000","last_undegraded":"2026-02-19T21:04:32.304912+0000","last_fullsized":"2026-02-19T21:04:32.304912+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:55:43.366371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441377+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:32.441377+0000","last_peered":"2026-02-19T21:04:32.441377+0000","last_clean":"2026-02-19T21:04:32.441377+0000","last_became_active":"2026-02-19T21:04:31.286657+0000","last_became_peered":"2026-02-19T21:04:31.286657+0000","last_unstale":"2026-02-19T21:04:32.441377+0000","last_undegraded":"2026-02-19T21:04:32.441377+0000","last_fullsized":"2026-02-19T21:04:32.441377+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:03.670491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306767+0000","last_change":"2026-02-19T21:04:30.410815+0000","last_active":"2026-02-19T21:04:32.306767+0000","last_peered":"2026-02-19T21:04:32.306767+0000","last_clean":"2026-02-19T21:04:32.306767+0000","last_became_active":"2026-02-19T21:04:30.410567+0000","last_became_peered":"2026-02-19T21:04:30.410567+0000","last_unstale":"2026-02-19T21:04:32.306767+0000","last_undegraded":"2026-02-19T21:04:32.306767+0000","last_fullsized":"2026-02-19T21:04:32.306767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:22.307313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441052+0000","last_change":"2026-02-19T21:04:31.288226+0000","last_active":"2026-02-19T21:04:32.441052+0000","last_peered":"2026-02-19T21:04:32.441052+0000","last_clean":"2026-02-19T21:04:32.441052+0000","last_became_active":"2026-02-19T21:04:31.287964+0000","last_became_peered":"2026-02-19T21:04:31.287964+0000","last_unstale":"2026-02-19T21:04:32.441052+0000","last_undegraded":"2026-02-19T21:04:32.441052+0000","last_fullsized":"2026-02-19T21:04:32.441052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:01.589256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305926+0000","last_change":"2026-02-19T21:04:30.408483+0000","last_active":"2026-02-19T21:04:32.305926+0000","last_peered":"2026-02-19T21:04:32.305926+0000","last_clean":"2026-02-19T21:04:32.305926+0000","last_became_active":"2026-02-19T21:04:30.408255+0000","last_became_peered":"2026-02-19T21:04:30.408255+0000","last_unstale":"2026-02-19T21:04:32.305926+0000","last_undegraded":"2026-02-19T21:04:32.305926+0000","last_fullsized":"2026-02-19T21:04:32.305926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:07:16.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441294+0000","last_change":"2026-02-19T21:04:31.287796+0000","last_active":"2026-02-19T21:04:32.441294+0000","last_peered":"2026-02-19T21:04:32.441294+0000","last_clean":"2026-02-19T21:04:32.441294+0000","last_became_active":"2026-02-19T21:04:31.287536+0000","last_became_peered":"2026-02-19T21:04:31.287536+0000","last_unstale":"2026-02-19T21:04:32.441294+0000","last_undegraded":"2026-02-19T21:04:32.441294+0000","last_fullsized":"2026-02-19T21:04:32.441294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:01.470441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":347,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440940+0000","last_change":"2026-02-19T21:04:12.238272+0000","last_active":"2026-02-19T21:04:32.440940+0000","last_peered":"2026-02-19T21:04:32.440940+0000","last_clean":"2026-02-19T21:04:32.440940+0000","last_became_active":"2026-02-19T21:04:12.238014+0000","last_became_peered":"2026-02-19T21:04:12.238014+0000","last_unstale":"2026-02-19T21:04:32.440940+0000","last_undegraded":"2026-02-19T21:04:32.440940+0000","last_fullsized":"2026-02-19T21:04:32.440940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_clean_scrub_stamp":"2026-02-19T21:03:12.107531+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:05:49.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305797+0000","last_change":"2026-02-19T21:04:30.410213+0000","last_active":"2026-02-19T21:04:32.305797+0000","last_peered":"2026-02-19T21:04:32.305797+0000","last_clean":"2026-02-19T21:04:32.305797+0000","last_became_active":"2026-02-19T21:04:30.410043+0000","last_became_peered":"2026-02-19T21:04:30.410043+0000","last_unstale":"2026-02-19T21:04:32.305797+0000","last_undegraded":"2026-02-19T21:04:32.305797+0000","last_fullsized":"2026-02-19T21:04:32.305797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:34:23.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304878+0000","last_change":"2026-02-19T21:04:31.285502+0000","last_active":"2026-02-19T21:04:32.304878+0000","last_peered":"2026-02-19T21:04:32.304878+0000","last_clean":"2026-02-19T21:04:32.304878+0000","last_became_active":"2026-02-19T21:04:31.285248+0000","last_became_peered":"2026-02-19T21:04:31.285248+0000","last_unstale":"2026-02-19T21:04:32.304878+0000","last_undegraded":"2026-02-19T21:04:32.304878+0000","last_fullsized":"2026-02-19T21:04:32.304878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:54.516813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.725634+0000","last_change":"2026-02-19T21:04:30.409547+0000","last_active":"2026-02-19T21:04:35.725634+0000","last_peered":"2026-02-19T21:04:35.725634+0000","last_clean":"2026-02-19T21:04:35.725634+0000","last_became_active":"2026-02-19T21:04:30.409191+0000","last_became_peered":"2026-02-19T21:04:30.409191+0000","last_unstale":"2026-02-19T21:04:35.725634+0000","last_undegraded":"2026-02-19T21:04:35.725634+0000","last_fullsized":"2026-02-19T21:04:35.725634+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:14:53.157004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304789+0000","last_change":"2026-02-19T21:04:31.287071+0000","last_active":"2026-02-19T21:04:32.304789+0000","last_peered":"2026-02-19T21:04:32.304789+0000","last_clean":"2026-02-19T21:04:32.304789+0000","last_became_active":"2026-02-19T21:04:31.286826+0000","last_became_peered":"2026-02-19T21:04:31.286826+0000","last_unstale":"2026-02-19T21:04:32.304789+0000","last_undegraded":"2026-02-19T21:04:32.304789+0000","last_fullsized":"2026-02-19T21:04:32.304789+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:26:22.218657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:37.729839+0000","last_change":"2026-02-19T21:04:30.407561+0000","last_active":"2026-02-19T21:04:37.729839+0000","last_peered":"2026-02-19T21:04:37.729839+0000","last_clean":"2026-02-19T21:04:37.729839+0000","last_became_active":"2026-02-19T21:04:30.407338+0000","last_became_peered":"2026-02-19T21:04:30.407338+0000","last_unstale":"2026-02-19T21:04:37.729839+0000","last_undegraded":"2026-02-19T21:04:37.729839+0000","last_fullsized":"2026-02-19T21:04:37.729839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:54:33.062163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306519+0000","last_change":"2026-02-19T21:04:31.289132+0000","last_active":"2026-02-19T21:04:32.306519+0000","last_peered":"2026-02-19T21:04:32.306519+0000","last_clean":"2026-02-19T21:04:32.306519+0000","last_became_active":"2026-02-19T21:04:31.288397+0000","last_became_peered":"2026-02-19T21:04:31.288397+0000","last_unstale":"2026-02-19T21:04:32.306519+0000","last_undegraded":"2026-02-19T21:04:32.306519+0000","last_fullsized":"2026-02-19T21:04:32.306519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:06:10.359363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.441033+0000","last_change":"2026-02-19T21:04:30.409909+0000","last_active":"2026-02-19T21:04:32.441033+0000","last_peered":"2026-02-19T21:04:32.441033+0000","last_clean":"2026-02-19T21:04:32.441033+0000","last_became_active":"2026-02-19T21:04:30.409595+0000","last_became_peered":"2026-02-19T21:04:30.409595+0000","last_unstale":"2026-02-19T21:04:32.441033+0000","last_undegraded":"2026-02-19T21:04:32.441033+0000","last_fullsized":"2026-02-19T21:04:32.441033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:34:26.108002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282333+0000","last_change":"2026-02-19T21:04:31.286428+0000","last_active":"2026-02-19T21:04:32.282333+0000","last_peered":"2026-02-19T21:04:32.282333+0000","last_clean":"2026-02-19T21:04:32.282333+0000","last_became_active":"2026-02-19T21:04:31.286150+0000","last_became_peered":"2026-02-19T21:04:31.286150+0000","last_unstale":"2026-02-19T21:04:32.282333+0000","last_undegraded":"2026-02-19T21:04:32.282333+0000","last_fullsized":"2026-02-19T21:04:32.282333+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:24:05.471458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.280914+0000","last_change":"2026-02-19T21:04:30.408729+0000","last_active":"2026-02-19T21:04:32.280914+0000","last_peered":"2026-02-19T21:04:32.280914+0000","last_clean":"2026-02-19T21:04:32.280914+0000","last_became_active":"2026-02-19T21:04:30.408489+0000","last_became_peered":"2026-02-19T21:04:30.408489+0000","last_unstale":"2026-02-19T21:04:32.280914+0000","last_undegraded":"2026-02-19T21:04:32.280914+0000","last_fullsized":"2026-02-19T21:04:32.280914+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:32.753162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:33.235599+0000","last_change":"2026-02-19T21:04:31.282620+0000","last_active":"2026-02-19T21:04:33.235599+0000","last_peered":"2026-02-19T21:04:33.235599+0000","last_clean":"2026-02-19T21:04:33.235599+0000","last_became_active":"2026-02-19T21:04:31.282207+0000","last_became_peered":"2026-02-19T21:04:31.282207+0000","last_unstale":"2026-02-19T21:04:33.235599+0000","last_undegraded":"2026-02-19T21:04:33.235599+0000","last_fullsized":"2026-02-19T21:04:33.235599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:22:05.657414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718711+0000","last_change":"2026-02-19T21:04:30.412136+0000","last_active":"2026-02-19T21:04:34.718711+0000","last_peered":"2026-02-19T21:04:34.718711+0000","last_clean":"2026-02-19T21:04:34.718711+0000","last_became_active":"2026-02-19T21:04:30.412001+0000","last_became_peered":"2026-02-19T21:04:30.412001+0000","last_unstale":"2026-02-19T21:04:34.718711+0000","last_undegraded":"2026-02-19T21:04:34.718711+0000","last_fullsized":"2026-02-19T21:04:34.718711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:27:51.577913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305006+0000","last_change":"2026-02-19T21:04:31.286103+0000","last_active":"2026-02-19T21:04:32.305006+0000","last_peered":"2026-02-19T21:04:32.305006+0000","last_clean":"2026-02-19T21:04:32.305006+0000","last_became_active":"2026-02-19T21:04:31.285858+0000","last_became_peered":"2026-02-19T21:04:31.285858+0000","last_unstale":"2026-02-19T21:04:32.305006+0000","last_undegraded":"2026-02-19T21:04:32.305006+0000","last_fullsized":"2026-02-19T21:04:32.305006+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:34.696574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.724574+0000","last_change":"2026-02-19T21:04:30.409209+0000","last_active":"2026-02-19T21:04:35.724574+0000","last_peered":"2026-02-19T21:04:35.724574+0000","last_clean":"2026-02-19T21:04:35.724574+0000","last_became_active":"2026-02-19T21:04:30.409013+0000","last_became_peered":"2026-02-19T21:04:30.409013+0000","last_unstale":"2026-02-19T21:04:35.724574+0000","last_undegraded":"2026-02-19T21:04:35.724574+0000","last_fullsized":"2026-02-19T21:04:35.724574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:36:18.396001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305202+0000","last_change":"2026-02-19T21:04:31.286348+0000","last_active":"2026-02-19T21:04:32.305202+0000","last_peered":"2026-02-19T21:04:32.305202+0000","last_clean":"2026-02-19T21:04:32.305202+0000","last_became_active":"2026-02-19T21:04:31.286157+0000","last_became_peered":"2026-02-19T21:04:31.286157+0000","last_unstale":"2026-02-19T21:04:32.305202+0000","last_undegraded":"2026-02-19T21:04:32.305202+0000","last_fullsized":"2026-02-19T21:04:32.305202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:57:02.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305981+0000","last_change":"2026-02-19T21:04:30.409263+0000","last_active":"2026-02-19T21:04:32.305981+0000","last_peered":"2026-02-19T21:04:32.305981+0000","last_clean":"2026-02-19T21:04:32.305981+0000","last_became_active":"2026-02-19T21:04:30.408394+0000","last_became_peered":"2026-02-19T21:04:30.408394+0000","last_unstale":"2026-02-19T21:04:32.305981+0000","last_undegraded":"2026-02-19T21:04:32.305981+0000","last_fullsized":"2026-02-19T21:04:32.305981+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:15:30.665040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304829+0000","last_change":"2026-02-19T21:04:31.287859+0000","last_active":"2026-02-19T21:04:32.304829+0000","last_peered":"2026-02-19T21:04:32.304829+0000","last_clean":"2026-02-19T21:04:32.304829+0000","last_became_active":"2026-02-19T21:04:31.287687+0000","last_became_peered":"2026-02-19T21:04:31.287687+0000","last_unstale":"2026-02-19T21:04:32.304829+0000","last_undegraded":"2026-02-19T21:04:32.304829+0000","last_fullsized":"2026-02-19T21:04:32.304829+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:26:18.995690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718234+0000","last_change":"2026-02-19T21:04:30.410334+0000","last_active":"2026-02-19T21:04:34.718234+0000","last_peered":"2026-02-19T21:04:34.718234+0000","last_clean":"2026-02-19T21:04:34.718234+0000","last_became_active":"2026-02-19T21:04:30.409928+0000","last_became_peered":"2026-02-19T21:04:30.409928+0000","last_unstale":"2026-02-19T21:04:34.718234+0000","last_undegraded":"2026-02-19T21:04:34.718234+0000","last_fullsized":"2026-02-19T21:04:34.718234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:21:33.041734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282558+0000","last_change":"2026-02-19T21:04:31.286369+0000","last_active":"2026-02-19T21:04:32.282558+0000","last_peered":"2026-02-19T21:04:32.282558+0000","last_clean":"2026-02-19T21:04:32.282558+0000","last_became_active":"2026-02-19T21:04:31.285908+0000","last_became_peered":"2026-02-19T21:04:31.285908+0000","last_unstale":"2026-02-19T21:04:32.282558+0000","last_undegraded":"2026-02-19T21:04:32.282558+0000","last_fullsized":"2026-02-19T21:04:32.282558+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:32:23.440567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.718269+0000","last_change":"2026-02-19T21:04:30.410110+0000","last_active":"2026-02-19T21:04:34.718269+0000","last_peered":"2026-02-19T21:04:34.718269+0000","last_clean":"2026-02-19T21:04:34.718269+0000","last_became_active":"2026-02-19T21:04:30.409864+0000","last_became_peered":"2026-02-19T21:04:30.409864+0000","last_unstale":"2026-02-19T21:04:34.718269+0000","last_undegraded":"2026-02-19T21:04:34.718269+0000","last_fullsized":"2026-02-19T21:04:34.718269+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:58:06.526168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306248+0000","last_change":"2026-02-19T21:04:31.287332+0000","last_active":"2026-02-19T21:04:32.306248+0000","last_peered":"2026-02-19T21:04:32.306248+0000","last_clean":"2026-02-19T21:04:32.306248+0000","last_became_active":"2026-02-19T21:04:31.287112+0000","last_became_peered":"2026-02-19T21:04:31.287112+0000","last_unstale":"2026-02-19T21:04:32.306248+0000","last_undegraded":"2026-02-19T21:04:32.306248+0000","last_fullsized":"2026-02-19T21:04:32.306248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:06:33.375075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305669+0000","last_change":"2026-02-19T21:04:30.410600+0000","last_active":"2026-02-19T21:04:32.305669+0000","last_peered":"2026-02-19T21:04:32.305669+0000","last_clean":"2026-02-19T21:04:32.305669+0000","last_became_active":"2026-02-19T21:04:30.410268+0000","last_became_peered":"2026-02-19T21:04:30.410268+0000","last_unstale":"2026-02-19T21:04:32.305669+0000","last_undegraded":"2026-02-19T21:04:32.305669+0000","last_fullsized":"2026-02-19T21:04:32.305669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:41:28.323119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304879+0000","last_change":"2026-02-19T21:04:31.284350+0000","last_active":"2026-02-19T21:04:32.304879+0000","last_peered":"2026-02-19T21:04:32.304879+0000","last_clean":"2026-02-19T21:04:32.304879+0000","last_became_active":"2026-02-19T21:04:31.284130+0000","last_became_peered":"2026-02-19T21:04:31.284130+0000","last_unstale":"2026-02-19T21:04:32.304879+0000","last_undegraded":"2026-02-19T21:04:32.304879+0000","last_fullsized":"2026-02-19T21:04:32.304879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:18:19.362792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:34.719332+0000","last_change":"2026-02-19T21:04:30.411333+0000","last_active":"2026-02-19T21:04:34.719332+0000","last_peered":"2026-02-19T21:04:34.719332+0000","last_clean":"2026-02-19T21:04:34.719332+0000","last_became_active":"2026-02-19T21:04:30.411052+0000","last_became_peered":"2026-02-19T21:04:30.411052+0000","last_unstale":"2026-02-19T21:04:34.719332+0000","last_undegraded":"2026-02-19T21:04:34.719332+0000","last_fullsized":"2026-02-19T21:04:34.719332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:13:12.351852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.440993+0000","last_change":"2026-02-19T21:04:31.287054+0000","last_active":"2026-02-19T21:04:32.440993+0000","last_peered":"2026-02-19T21:04:32.440993+0000","last_clean":"2026-02-19T21:04:32.440993+0000","last_became_active":"2026-02-19T21:04:31.286548+0000","last_became_peered":"2026-02-19T21:04:31.286548+0000","last_unstale":"2026-02-19T21:04:32.440993+0000","last_undegraded":"2026-02-19T21:04:32.440993+0000","last_fullsized":"2026-02-19T21:04:32.440993+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:15.932826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.306581+0000","last_change":"2026-02-19T21:04:31.289365+0000","last_active":"2026-02-19T21:04:32.306581+0000","last_peered":"2026-02-19T21:04:32.306581+0000","last_clean":"2026-02-19T21:04:32.306581+0000","last_became_active":"2026-02-19T21:04:31.288986+0000","last_became_peered":"2026-02-19T21:04:31.288986+0000","last_unstale":"2026-02-19T21:04:32.306581+0000","last_undegraded":"2026-02-19T21:04:32.306581+0000","last_fullsized":"2026-02-19T21:04:32.306581+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:55:08.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.282837+0000","last_change":"2026-02-19T21:04:30.410600+0000","last_active":"2026-02-19T21:04:32.282837+0000","last_peered":"2026-02-19T21:04:32.282837+0000","last_clean":"2026-02-19T21:04:32.282837+0000","last_became_active":"2026-02-19T21:04:30.410193+0000","last_became_peered":"2026-02-19T21:04:30.410193+0000","last_unstale":"2026-02-19T21:04:32.282837+0000","last_undegraded":"2026-02-19T21:04:32.282837+0000","last_fullsized":"2026-02-19T21:04:32.282837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:39:35.864646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305059+0000","last_change":"2026-02-19T21:04:31.287464+0000","last_active":"2026-02-19T21:04:32.305059+0000","last_peered":"2026-02-19T21:04:32.305059+0000","last_clean":"2026-02-19T21:04:32.305059+0000","last_became_active":"2026-02-19T21:04:31.287159+0000","last_became_peered":"2026-02-19T21:04:31.287159+0000","last_unstale":"2026-02-19T21:04:32.305059+0000","last_undegraded":"2026-02-19T21:04:32.305059+0000","last_fullsized":"2026-02-19T21:04:32.305059+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:30:26.608871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.725561+0000","last_change":"2026-02-19T21:04:30.411307+0000","last_active":"2026-02-19T21:04:35.725561+0000","last_peered":"2026-02-19T21:04:35.725561+0000","last_clean":"2026-02-19T21:04:35.725561+0000","last_became_active":"2026-02-19T21:04:30.411044+0000","last_became_peered":"2026-02-19T21:04:30.411044+0000","last_unstale":"2026-02-19T21:04:35.725561+0000","last_undegraded":"2026-02-19T21:04:35.725561+0000","last_fullsized":"2026-02-19T21:04:35.725561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:39:22.516979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.304983+0000","last_change":"2026-02-19T21:04:31.286139+0000","last_active":"2026-02-19T21:04:32.304983+0000","last_peered":"2026-02-19T21:04:32.304983+0000","last_clean":"2026-02-19T21:04:32.304983+0000","last_became_active":"2026-02-19T21:04:31.285718+0000","last_became_peered":"2026-02-19T21:04:31.285718+0000","last_unstale":"2026-02-19T21:04:32.304983+0000","last_undegraded":"2026-02-19T21:04:32.304983+0000","last_fullsized":"2026-02-19T21:04:32.304983+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:15:18.002138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305250+0000","last_change":"2026-02-19T21:04:30.410568+0000","last_active":"2026-02-19T21:04:32.305250+0000","last_peered":"2026-02-19T21:04:32.305250+0000","last_clean":"2026-02-19T21:04:32.305250+0000","last_became_active":"2026-02-19T21:04:30.410323+0000","last_became_peered":"2026-02-19T21:04:30.410323+0000","last_unstale":"2026-02-19T21:04:32.305250+0000","last_undegraded":"2026-02-19T21:04:32.305250+0000","last_fullsized":"2026-02-19T21:04:32.305250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:14:30.270933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:32.305147+0000","last_change":"2026-02-19T21:04:31.286019+0000","last_active":"2026-02-19T21:04:32.305147+0000","last_peered":"2026-02-19T21:04:32.305147+0000","last_clean":"2026-02-19T21:04:32.305147+0000","last_became_active":"2026-02-19T21:04:31.285608+0000","last_became_peered":"2026-02-19T21:04:31.285608+0000","last_unstale":"2026-02-19T21:04:32.305147+0000","last_undegraded":"2026-02-19T21:04:32.305147+0000","last_fullsized":"2026-02-19T21:04:32.305147+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:34:30.034673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2026-02-19T21:04:35.725153+0000","last_change":"2026-02-19T21:04:30.409329+0000","last_active":"2026-02-19T21:04:35.725153+0000","last_peered":"2026-02-19T21:04:35.725153+0000","last_clean":"2026-02-19T21:04:35.725153+0000","last_became_active":"2026-02-19T21:04:30.408892+0000","last_became_peered":"2026-02-19T21:04:30.408892+0000","last_unstale":"2026-02-19T21:04:35.725153+0000","last_undegraded":"2026-02-19T21:04:35.725153+0000","last_fullsized":"2026-02-19T21:04:35.725153+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:16:52.316860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":28044,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":17,"num_read_kb":38,"num_write":116,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":44497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":115561,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710725,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27756,"kb_used_data":792,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975444,"statfs":{"total":751619276800,"available":751590854656,"internally_reserved":0,"allocated":811008,"data_stored":394318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8794,"internal_metadata":27581862},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939655,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28384,"kb_used_data":1420,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733974816,"statfs":{"total":751619276800,"available":751590211584,"internally_reserved":0,"allocated":1454080,"data_stored":994671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27495,"internal_metadata":27563161},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070473,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":395124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21808,"internal_metadata":27568848},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299403,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":395078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20493,"internal_metadata":27570163},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528331,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28348,"kb_used_data":1384,"kb_used_omap":25,"kb_used_meta":26918,"kb_avail":733974852,"statfs":{"total":751619276800,"available":751590248448,"internally_reserved":0,"allocated":1417216,"data_stored":985912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26184,"internal_metadata":27564472},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659150,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":26,"kb_used_meta":26917,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":394525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":27075,"internal_metadata":27563581},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888078,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28364,"kb_used_data":1400,"kb_used_omap":19,"kb_used_meta":26924,"kb_avail":733974836,"statfs":{"total":751619276800,"available":751590232064,"internally_reserved":0,"allocated":1433600,"data_stored":986184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20015,"internal_metadata":27570641},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27760,"kb_used_data":796,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733975440,"statfs":{"total":751619276800,"available":751590850560,"internally_reserved":0,"allocated":815104,"data_stored":394340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31913,"internal_metadata":27558743},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247826,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":394602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45312,"internal_metadata":27545344},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476755,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":395986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49734,"internal_metadata":27540922},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607572,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44320,"internal_metadata":27546336},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27768,"kb_used_data":804,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975432,"statfs":{"total":751619276800,"available":751590842368,"internally_reserved":0,"allocated":823296,"data_stored":395034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47647,"internal_metadata":27543009},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9192,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8946,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17796,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6310,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5193,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6276,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20535,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9881,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14668,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":27194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12820,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-19T21:04:40.338 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-19T21:04:40.338 INFO:tasks.cephadm:Setting up client nodes... 2026-02-19T21:04:40.338 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-19T21:04:40.496 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:40.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2531000372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410fbf0 msgr2=0x7f3134114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2531000372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410fbf0 0x7f3134114c30 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=15421213048377674659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31280099a0 tx=0x7f312802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2531000372 shutdown_connections 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2531000372 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3134115410 0x7f3134175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2531000372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410fbf0 0x7f3134114c30 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=15421213048377674659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2531000372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f313410f200 0x7f313410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2531000372 >> 10.20.193.90:0/2531000372 conn(0x7f31340ecac0 msgr2=0x7f313410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2531000372 shutdown_connections 2026-02-19T21:04:40.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2531000372 wait complete. 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 Processor -- start 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- start start 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 0x7f31340f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3134115410 0x7f3134175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f31340f5260 0x7f31340fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31340f5950 con 0x7f313410f200 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31340faa70 con 0x7f31340f5260 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313c7d96c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31340fac30 con 0x7f3134115410 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 0x7f31340f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 0x7f31340f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43536/0 (socket says 10.20.193.90:43536) 2026-02-19T21:04:40.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 -- 10.20.193.90:0/2157696508 learned_addr learned my addr 10.20.193.90:0/2157696508 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313ad4b6c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f31340f5260 0x7f31340fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 -- 10.20.193.90:0/2157696508 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3134115410 msgr2=0x7f3134175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3134115410 0x7f3134175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 -- 10.20.193.90:0/2157696508 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f31340f5260 msgr2=0x7f31340fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f31340f5260 0x7f31340fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313a54a6c0 1 -- 10.20.193.90:0/2157696508 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3128009590 con 0x7f313410f200 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.613+0000 7f313ad4b6c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f31340f5260 0x7f31340fa530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f313a54a6c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 0x7f31340f4c30 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312400b710 tx=0x7f312400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3124004250 con 0x7f313410f200 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3124009070 con 0x7f313410f200 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31340faf10 con 0x7f313410f200 2026-02-19T21:04:40.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f312400ccd0 con 0x7f313410f200 2026-02-19T21:04:40.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31340fb6a0 con 0x7f313410f200 2026-02-19T21:04:40.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.614+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31341104d0 con 0x7f313410f200 2026-02-19T21:04:40.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.615+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f31240028c0 con 0x7f313410f200 2026-02-19T21:04:40.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.616+0000 7f311b7fe6c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31100b5760 0x7f31100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:40.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.616+0000 7f3139d496c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31100b5760 0x7f31100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:40.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.616+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f31240e3d10 con 0x7f313410f200 2026-02-19T21:04:40.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.616+0000 7f3139d496c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31100b5760 0x7f31100d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31280098c0 tx=0x7f3128005bc0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:40.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.617+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f31240a66a0 con 0x7f313410f200 2026-02-19T21:04:40.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.746+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f313410f5d0 con 0x7f313410f200 2026-02-19T21:04:40.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.747+0000 7f311b7fe6c0 1 -- 10.20.193.90:0/2157696508 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f312400ce60 con 0x7f313410f200 2026-02-19T21:04:40.749 INFO:teuthology.orchestra.run.trial090.stdout:[client.0] 2026-02-19T21:04:40.749 INFO:teuthology.orchestra.run.trial090.stdout: key = AQDoepdp0TKMLBAArCHT3w2e0XBe5mA97dnlDA== 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.748+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31100b5760 msgr2=0x7f31100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.748+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31100b5760 0x7f31100d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31280098c0 tx=0x7f3128005bc0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.748+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 msgr2=0x7f31340f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.748+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 0x7f31340f4c30 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312400b710 tx=0x7f312400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 shutdown_connections 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31100b5760 0x7f31100d5c10 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f31340f5260 0x7f31340fa530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3134115410 0x7f3134175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 --2- 10.20.193.90:0/2157696508 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f313410f200 0x7f31340f4c30 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:40.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 >> 10.20.193.90:0/2157696508 conn(0x7f31340ecac0 msgr2=0x7f313410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:40.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 shutdown_connections 2026-02-19T21:04:40.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:40.749+0000 7f313c7d96c0 1 -- 10.20.193.90:0/2157696508 wait complete. 2026-02-19T21:04:40.789 DEBUG:teuthology.orchestra.run.trial090:> set -ex 2026-02-19T21:04:40.789 DEBUG:teuthology.orchestra.run.trial090:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-19T21:04:40.789 DEBUG:teuthology.orchestra.run.trial090:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-19T21:04:40.830 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-19T21:04:40.989 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:41.010 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:40 trial090 ceph-mon[31759]: mgrmap e15: x(active, since 118s), standbys: z, y 2026-02-19T21:04:41.011 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:40 trial090 ceph-mon[31759]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:41.011 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:40 trial090 ceph-mon[31759]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:41.011 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:40 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2157696508' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-19T21:04:41.011 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:40 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2157696508' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-19T21:04:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:40 trial175 ceph-mon[34116]: mgrmap e15: x(active, since 118s), standbys: z, y 2026-02-19T21:04:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:40 trial175 ceph-mon[34116]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:40 trial175 ceph-mon[34116]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:40 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2157696508' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-19T21:04:41.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:40 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2157696508' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-19T21:04:41.114 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- 10.20.193.90:0/3728018118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa25410cf70 msgr2=0x7fa25410d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.114 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- 10.20.193.90:0/3728018118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa25410cf70 0x7fa25410d340 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=9745227411708567901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa2480099a0 tx=0x7fa24802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:41.114 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- 10.20.193.90:0/3728018118 shutdown_connections 2026-02-19T21:04:41.114 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- 10.20.193.90:0/3728018118 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa254113180 0x7fa254173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.114 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- 10.20.193.90:0/3728018118 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa25410d960 0x7fa2541129a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- 10.20.193.90:0/3728018118 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa25410cf70 0x7fa25410d340 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=9745227411708567901 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- 10.20.193.90:0/3728018118 >> 10.20.193.90:0/3728018118 conn(0x7fa2540ea870 msgr2=0x7fa25410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- 10.20.193.90:0/3728018118 shutdown_connections 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- 10.20.193.90:0/3728018118 wait complete. 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 Processor -- start 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- start start 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa25410cf70 0x7fa25411b050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 0x7fa25411b590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa254120950 0x7fa254120df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa254121330 con 0x7fa254113180 2026-02-19T21:04:41.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541214a0 con 0x7fa25410cf70 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.110+0000 7fa258e416c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa254121660 con 0x7fa254120950 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 0x7fa25411b590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 0x7fa25411b590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43562/0 (socket says 10.20.193.90:43562) 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 -- 10.20.193.90:0/382016120 learned_addr learned my addr 10.20.193.90:0/382016120 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 -- 10.20.193.90:0/382016120 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa254120950 msgr2=0x7fa254120df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa254120950 0x7fa254120df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 -- 10.20.193.90:0/382016120 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa25410cf70 msgr2=0x7fa25411b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa25410cf70 0x7fa25411b050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 -- 10.20.193.90:0/382016120 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa248009590 con 0x7fa254113180 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa251d746c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 0x7fa25411b590 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa23c00b650 tx=0x7fa23c00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa23c0044a0 con 0x7fa254113180 2026-02-19T21:04:41.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa23c009030 con 0x7fa254113180 2026-02-19T21:04:41.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa23c00cc10 con 0x7fa254113180 2026-02-19T21:04:41.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa254161ae0 con 0x7fa254113180 2026-02-19T21:04:41.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa254161f70 con 0x7fa254113180 2026-02-19T21:04:41.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.111+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25410e240 con 0x7fa254113180 2026-02-19T21:04:41.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.113+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fa23c0026b0 con 0x7fa254113180 2026-02-19T21:04:41.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.113+0000 7fa23b7fe6c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa22c0b5760 0x7fa22c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.113+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7fa23c0e3ba0 con 0x7fa254113180 2026-02-19T21:04:41.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.113+0000 7fa2525756c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa22c0b5760 0x7fa22c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.118 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.113+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa23c0a94c0 con 0x7fa254113180 2026-02-19T21:04:41.119 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.114+0000 7fa2525756c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa22c0b5760 0x7fa22c0d5c10 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa248005b40 tx=0x7fa248005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:41.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:40 trial105 ceph-mon[33883]: mgrmap e15: x(active, since 118s), standbys: z, y 2026-02-19T21:04:41.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:40 trial105 ceph-mon[33883]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:41.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:40 trial105 ceph-mon[33883]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:41.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:40 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2157696508' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-19T21:04:41.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:40 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2157696508' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-19T21:04:41.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.203+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa25410d340 con 0x7fa254113180 2026-02-19T21:04:41.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.203+0000 7fa23b7fe6c0 1 -- 10.20.193.90:0/382016120 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v50) ==== 86+0+133 (secure 0 0 0) 0x7fa23c0a96a0 con 0x7fa254113180 2026-02-19T21:04:41.206 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa22c0b5760 msgr2=0x7fa22c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa22c0b5760 0x7fa22c0d5c10 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa248005b40 tx=0x7fa248005c60 comp rx=0 tx=0).stop 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 msgr2=0x7fa25411b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 0x7fa25411b590 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa23c00b650 tx=0x7fa23c00bb20 comp rx=0 tx=0).stop 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 shutdown_connections 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa22c0b5760 0x7fa22c0d5c10 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa254120950 0x7fa254120df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa254113180 0x7fa25411b590 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 --2- 10.20.193.90:0/382016120 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa25410cf70 0x7fa25411b050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 >> 10.20.193.90:0/382016120 conn(0x7fa2540ea870 msgr2=0x7fa25410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:41.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 shutdown_connections 2026-02-19T21:04:41.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.204+0000 7fa258e416c0 1 -- 10.20.193.90:0/382016120 wait complete. 2026-02-19T21:04:41.246 INFO:teuthology.orchestra.run.trial090.stdout:[{"version":50,"timestamp":"2026-02-19T21:04:26.666633+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-19T21:04:41.246 INFO:tasks.ceph_manager:config epoch is 50 2026-02-19T21:04:41.246 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-19T21:04:41.247 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-19T21:04:41.247 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-19T21:04:41.370 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/2933952199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 msgr2=0x7f5eb805fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/2933952199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb805fba0 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=8085765686745235904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea40099a0 tx=0x7f5ea402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/2933952199 shutdown_connections 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/2933952199 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eb8113180 0x7f5eb8173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/2933952199 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eb80601c0 0x7f5eb81129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/2933952199 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb805fba0 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=8085765686745235904 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.493 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/2933952199 >> 10.20.193.90:0/2933952199 conn(0x7f5eb80e96f0 msgr2=0x7f5eb8109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/2933952199 shutdown_connections 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/2933952199 wait complete. 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 Processor -- start 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 -- start start 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.489+0000 7f5ebe2ad6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb811b0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eb8113180 0x7f5eb811b600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eb81209c0 0x7f5eb8120e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb81213d0 con 0x7f5eb805f7d0 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8121540 con 0x7f5eb8113180 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb8121700 con 0x7f5eb81209c0 2026-02-19T21:04:41.494 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb811b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb811b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43572/0 (socket says 10.20.193.90:43572) 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 -- 10.20.193.90:0/3296340152 learned_addr learned my addr 10.20.193.90:0/3296340152 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb77fe6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eb8113180 0x7f5eb811b600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebc81f6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eb81209c0 0x7f5eb8120e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 -- 10.20.193.90:0/3296340152 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eb81209c0 msgr2=0x7f5eb8120e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eb81209c0 0x7f5eb8120e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 -- 10.20.193.90:0/3296340152 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eb8113180 msgr2=0x7f5eb811b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eb8113180 0x7f5eb811b600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 -- 10.20.193.90:0/3296340152 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea4009590 con 0x7f5eb805f7d0 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb7fff6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb811b0c0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea402f230 tx=0x7f5ea402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:41.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea4002ba0 con 0x7f5eb805f7d0 2026-02-19T21:04:41.496 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5ea4002d00 con 0x7f5eb805f7d0 2026-02-19T21:04:41.496 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb8161b50 con 0x7f5eb805f7d0 2026-02-19T21:04:41.496 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ea40372f0 con 0x7f5eb805f7d0 2026-02-19T21:04:41.496 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb8161fd0 con 0x7f5eb805f7d0 2026-02-19T21:04:41.496 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.490+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb810e240 con 0x7f5eb805f7d0 2026-02-19T21:04:41.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.492+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f5ea40078d0 con 0x7f5eb805f7d0 2026-02-19T21:04:41.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.492+0000 7f5eb57fa6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5e8c0b5760 0x7f5e8c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.492+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7977+0+0 (secure 0 0 0) 0x7f5ea4107d70 con 0x7f5eb805f7d0 2026-02-19T21:04:41.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.492+0000 7f5eb77fe6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5e8c0b5760 0x7f5e8c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.492+0000 7f5eb77fe6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5e8c0b5760 0x7f5e8c0d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea8005980 tx=0x7f5ea8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:41.498 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.493+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5ea40ca6c0 con 0x7f5eb805f7d0 2026-02-19T21:04:41.612 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.610+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5eb811c270 con 0x7f5eb805f7d0 2026-02-19T21:04:41.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.613+0000 7f5eb57fa6c0 1 -- 10.20.193.90:0/3296340152 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v15) ==== 74+0+297590 (secure 0 0 0) 0x7f5ea40cd870 con 0x7f5eb805f7d0 2026-02-19T21:04:41.618 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5e8c0b5760 msgr2=0x7f5e8c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5e8c0b5760 0x7f5e8c0d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea8005980 tx=0x7f5ea8005910 comp rx=0 tx=0).stop 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 msgr2=0x7f5eb811b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb811b0c0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ea402f230 tx=0x7f5ea402fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 shutdown_connections 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5e8c0b5760 0x7f5e8c0d5c10 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5eb81209c0 0x7f5eb8120e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5eb8113180 0x7f5eb811b600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 --2- 10.20.193.90:0/3296340152 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5eb805f7d0 0x7f5eb811b0c0 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 >> 10.20.193.90:0/3296340152 conn(0x7f5eb80e96f0 msgr2=0x7f5eb8109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:41.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 shutdown_connections 2026-02-19T21:04:41.622 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.615+0000 7f5ebe2ad6c0 1 -- 10.20.193.90:0/3296340152 wait complete. 2026-02-19T21:04:41.657 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":15,"flags":0,"active_gid":14193,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6800","nonce":151235046},{"type":"v1","addr":"10.20.193.90:6801","nonce":151235046}]},"active_addr":"10.20.193.90:6801/151235046","active_change":"2026-02-19T21:02:41.080285+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24241,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24281,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":4,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":3556425428}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":446462426}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":2596887833}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":990160480}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.90:0","nonce":2095672100}]}]} 2026-02-19T21:04:41.667 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-19T21:04:41.668 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-19T21:04:41.668 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T21:04:41.823 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:41.869 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: pgmap v180: 97 pgs: 97 active+clean; 605 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-19T21:04:41.869 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2026-02-19T21:04:41.869 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/382016120' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-19T21:04:41.870 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:41 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3296340152' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/1901686558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d810f200 msgr2=0x7fe1d810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/1901686558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d810f200 0x7fe1d810f5d0 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=13995208646757312280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1c80099a0 tx=0x7fe1c802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/1901686558 shutdown_connections 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/1901686558 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe1d8115410 0x7fe1d8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/1901686558 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d810fbf0 0x7fe1d8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/1901686558 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d810f200 0x7fe1d810f5d0 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=13995208646757312280 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/1901686558 >> 10.20.193.90:0/1901686558 conn(0x7fe1d80ecac0 msgr2=0x7fe1d810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/1901686558 shutdown_connections 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/1901686558 wait complete. 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 Processor -- start 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- start start 2026-02-19T21:04:41.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe1d810f200 0x7fe1d80666a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 0x7fe1d8062900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d8062e90 0x7fe1d8063330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8167d20 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8167e90 con 0x7fe1d8062e90 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1df3ec6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8168050 con 0x7fe1d810f200 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 0x7fe1d8062900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 0x7fe1d8062900 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43586/0 (socket says 10.20.193.90:43586) 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 -- 10.20.193.90:0/2227958270 learned_addr learned my addr 10.20.193.90:0/2227958270 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dd95e6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d8062e90 0x7fe1d8063330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dd15d6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe1d810f200 0x7fe1d80666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 -- 10.20.193.90:0/2227958270 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe1d810f200 msgr2=0x7fe1d80666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe1d810f200 0x7fe1d80666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 -- 10.20.193.90:0/2227958270 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d8062e90 msgr2=0x7fe1d8063330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d8062e90 0x7fe1d8063330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.939+0000 7fe1dc95c6c0 1 -- 10.20.193.90:0/2227958270 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c8009590 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1dd95e6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d8062e90 0x7fe1d8063330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1dc95c6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 0x7fe1d8062900 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1cc005dc0 tx=0x7fe1cc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1cc004250 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe1cc009070 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d8168330 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1cc00cd50 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d8168810 con 0x7fe1d8115410 2026-02-19T21:04:41.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.940+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d81104d0 con 0x7fe1d8115410 2026-02-19T21:04:41.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.941+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fe1cc0028c0 con 0x7fe1d8115410 2026-02-19T21:04:41.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.942+0000 7fe1c67fc6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe1b40b56e0 0x7fe1b40d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:41.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.942+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7fe1cc0e3d50 con 0x7fe1d8115410 2026-02-19T21:04:41.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.942+0000 7fe1dd15d6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe1b40b56e0 0x7fe1b40d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:41.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.942+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe1cc0a65a0 con 0x7fe1d8115410 2026-02-19T21:04:41.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:41.942+0000 7fe1dd15d6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe1b40b56e0 0x7fe1b40d5b90 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1c80092e0 tx=0x7fe1c8005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: pgmap v180: 97 pgs: 97 active+clean; 605 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/382016120' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-19T21:04:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:41 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3296340152' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-19T21:04:42.037 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.035+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1d810fbf0 con 0x7fe1d8115410 2026-02-19T21:04:42.037 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.036+0000 7fe1c67fc6c0 1 -- 10.20.193.90:0/2227958270 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22760 (secure 0 0 0) 0x7fe1cc0a9750 con 0x7fe1d8115410 2026-02-19T21:04:42.037 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:42.038 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":76,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","created":"2026-02-19T21:02:03.870776+0000","modified":"2026-02-19T21:04:41.764093+0000","last_up_change":"2026-02-19T21:04:15.914313+0000","last_in_change":"2026-02-19T21:04:07.215369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T21:03:11.280767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-19T21:04:28.620551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-19T21:04:29.792203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9447a1db-db31-41c0-8732-78156b284c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6803","nonce":300222624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6805","nonce":300222624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6809","nonce":300222624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6807","nonce":300222624}]},"public_addr":"10.20.193.90:6803/300222624","cluster_addr":"10.20.193.90:6805/300222624","heartbeat_back_addr":"10.20.193.90:6809/300222624","heartbeat_front_addr":"10.20.193.90:6807/300222624","state":["exists","up"]},{"osd":1,"uuid":"2ceb6ac4-0471-49bc-b664-7b5053f54250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6801","nonce":515149626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6803","nonce":515149626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6807","nonce":515149626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6805","nonce":515149626}]},"public_addr":"10.20.193.105:6801/515149626","cluster_addr":"10.20.193.105:6803/515149626","heartbeat_back_addr":"10.20.193.105:6807/515149626","heartbeat_front_addr":"10.20.193.105:6805/515149626","state":["exists","up"]},{"osd":2,"uuid":"8ded8050-146f-41a3-a2e7-974118414769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6800","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6801","nonce":2163707084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6802","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6803","nonce":2163707084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6806","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6807","nonce":2163707084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6804","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6805","nonce":2163707084}]},"public_addr":"10.20.193.175:6801/2163707084","cluster_addr":"10.20.193.175:6803/2163707084","heartbeat_back_addr":"10.20.193.175:6807/2163707084","heartbeat_front_addr":"10.20.193.175:6805/2163707084","state":["exists","up"]},{"osd":3,"uuid":"556df040-373e-4795-af5e-297ede87881b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6811","nonce":1075832494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6813","nonce":1075832494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6817","nonce":1075832494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6815","nonce":1075832494}]},"public_addr":"10.20.193.90:6811/1075832494","cluster_addr":"10.20.193.90:6813/1075832494","heartbeat_back_addr":"10.20.193.90:6817/1075832494","heartbeat_front_addr":"10.20.193.90:6815/1075832494","state":["exists","up"]},{"osd":4,"uuid":"a0776450-d439-4c5d-a67d-0ae50bb72319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6809","nonce":891701520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6811","nonce":891701520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6815","nonce":891701520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6813","nonce":891701520}]},"public_addr":"10.20.193.105:6809/891701520","cluster_addr":"10.20.193.105:6811/891701520","heartbeat_back_addr":"10.20.193.105:6815/891701520","heartbeat_front_addr":"10.20.193.105:6813/891701520","state":["exists","up"]},{"osd":5,"uuid":"3450f832-0b90-45d7-a92d-b74809259564","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6808","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6809","nonce":1433153714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6810","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6811","nonce":1433153714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6814","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6815","nonce":1433153714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6812","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6813","nonce":1433153714}]},"public_addr":"10.20.193.175:6809/1433153714","cluster_addr":"10.20.193.175:6811/1433153714","heartbeat_back_addr":"10.20.193.175:6815/1433153714","heartbeat_front_addr":"10.20.193.175:6813/1433153714","state":["exists","up"]},{"osd":6,"uuid":"9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6819","nonce":4121266153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6821","nonce":4121266153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6825","nonce":4121266153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6823","nonce":4121266153}]},"public_addr":"10.20.193.90:6819/4121266153","cluster_addr":"10.20.193.90:6821/4121266153","heartbeat_back_addr":"10.20.193.90:6825/4121266153","heartbeat_front_addr":"10.20.193.90:6823/4121266153","state":["exists","up"]},{"osd":7,"uuid":"6b119453-b94f-441f-8685-a992fe2922ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6817","nonce":3597166844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6818","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6819","nonce":3597166844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6822","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6823","nonce":3597166844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6820","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6821","nonce":3597166844}]},"public_addr":"10.20.193.105:6817/3597166844","cluster_addr":"10.20.193.105:6819/3597166844","heartbeat_back_addr":"10.20.193.105:6823/3597166844","heartbeat_front_addr":"10.20.193.105:6821/3597166844","state":["exists","up"]},{"osd":8,"uuid":"fdfc8889-7eda-48ef-ae9d-5ec9cb798a56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6816","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6817","nonce":711294156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6818","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6819","nonce":711294156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6822","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6823","nonce":711294156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6820","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6821","nonce":711294156}]},"public_addr":"10.20.193.175:6817/711294156","cluster_addr":"10.20.193.175:6819/711294156","heartbeat_back_addr":"10.20.193.175:6823/711294156","heartbeat_front_addr":"10.20.193.175:6821/711294156","state":["exists","up"]},{"osd":9,"uuid":"bfa36c36-03aa-4363-85f7-b4cd9450b612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6827","nonce":72013082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6829","nonce":72013082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6833","nonce":72013082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6831","nonce":72013082}]},"public_addr":"10.20.193.90:6827/72013082","cluster_addr":"10.20.193.90:6829/72013082","heartbeat_back_addr":"10.20.193.90:6833/72013082","heartbeat_front_addr":"10.20.193.90:6831/72013082","state":["exists","up"]},{"osd":10,"uuid":"43e47e1a-7160-446c-8fe3-8a20cc2a4c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6824","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6825","nonce":3923796147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6826","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6827","nonce":3923796147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6830","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6831","nonce":3923796147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6828","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6829","nonce":3923796147}]},"public_addr":"10.20.193.105:6825/3923796147","cluster_addr":"10.20.193.105:6827/3923796147","heartbeat_back_addr":"10.20.193.105:6831/3923796147","heartbeat_front_addr":"10.20.193.105:6829/3923796147","state":["exists","up"]},{"osd":11,"uuid":"b789e6a7-be92-4cae-a3a0-d6eebe9b8629","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6824","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6825","nonce":3785438366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6826","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6827","nonce":3785438366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6830","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6831","nonce":3785438366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6828","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6829","nonce":3785438366}]},"public_addr":"10.20.193.175:6825/3785438366","cluster_addr":"10.20.193.175:6827/3785438366","heartbeat_back_addr":"10.20.193.175:6831/3785438366","heartbeat_front_addr":"10.20.193.175:6829/3785438366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:02:53.889642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:00.781533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:08.187332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:15.317071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:22.497099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:29.848931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:37.269086+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:44.452146+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:51.824076+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:59.325996+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:06.588398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:14.010218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/1864372684":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6800/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1997858222":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/66846304":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6801/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6800/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/2504907435":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6801/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1301435029":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/4201652812":"2026-02-20T21:02:09.876469+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T21:04:42.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe1b40b56e0 msgr2=0x7fe1b40d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe1b40b56e0 0x7fe1b40d5b90 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1c80092e0 tx=0x7fe1c8005c00 comp rx=0 tx=0).stop 2026-02-19T21:04:42.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 msgr2=0x7fe1d8062900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 0x7fe1d8062900 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1cc005dc0 tx=0x7fe1cc00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 shutdown_connections 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe1b40b56e0 0x7fe1b40d5b90 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe1d8062e90 0x7fe1d8063330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe1d8115410 0x7fe1d8062900 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 --2- 10.20.193.90:0/2227958270 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe1d810f200 0x7fe1d80666a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 >> 10.20.193.90:0/2227958270 conn(0x7fe1d80ecac0 msgr2=0x7fe1d810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 shutdown_connections 2026-02-19T21:04:42.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.037+0000 7fe1df3ec6c0 1 -- 10.20.193.90:0/2227958270 wait complete. 2026-02-19T21:04:42.076 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-19T21:04:42.076 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd dump --format=json 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: pgmap v180: 97 pgs: 97 active+clean; 605 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]} : dispatch 2026-02-19T21:04:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/382016120' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-19T21:04:42.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:41 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3296340152' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-19T21:04:42.201 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 -- 10.20.193.90:0/3265730256 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 msgr2=0x7f6690175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/3265730256 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f6690175db0 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=43565111174923586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f668000aa70 tx=0x7f668002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 -- 10.20.193.90:0/3265730256 shutdown_connections 2026-02-19T21:04:42.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/3265730256 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f6690175db0 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=43565111174923586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/3265730256 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010fbf0 0x7f6690114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/3265730256 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f669010f200 0x7f669010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 -- 10.20.193.90:0/3265730256 >> 10.20.193.90:0/3265730256 conn(0x7f66900ecac0 msgr2=0x7f669010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 -- 10.20.193.90:0/3265730256 shutdown_connections 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.318+0000 7f66952fc6c0 1 -- 10.20.193.90:0/3265730256 wait complete. 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 Processor -- start 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 -- start start 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010f200 0x7f669011d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f669011d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6690122b20 0x7f6690122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6690123530 con 0x7f6690115410 2026-02-19T21:04:42.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66901236a0 con 0x7f669010f200 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6690123860 con 0x7f6690122b20 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f669011d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f669011d760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43616/0 (socket says 10.20.193.90:43616) 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 -- 10.20.193.90:0/77448472 learned_addr learned my addr 10.20.193.90:0/77448472 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668f7fe6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6690122b20 0x7f6690122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668effd6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010f200 0x7f669011d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 -- 10.20.193.90:0/77448472 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6690122b20 msgr2=0x7f6690122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6690122b20 0x7f6690122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 -- 10.20.193.90:0/77448472 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010f200 msgr2=0x7f669011d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010f200 0x7f669011d220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 -- 10.20.193.90:0/77448472 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668000a660 con 0x7f6690115410 2026-02-19T21:04:42.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668f7fe6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6690122b20 0x7f6690122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668effd6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010f200 0x7f669011d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f668e7fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f669011d760 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f667800b6c0 tx=0x7f667800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66780044a0 con 0x7f6690115410 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6690163d10 con 0x7f6690115410 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901641f0 con 0x7f6690115410 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6678009030 con 0x7f6690115410 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.319+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f667800cc10 con 0x7f6690115410 2026-02-19T21:04:42.325 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.320+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66901104d0 con 0x7f6690115410 2026-02-19T21:04:42.326 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.321+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f66780026b0 con 0x7f6690115410 2026-02-19T21:04:42.326 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.322+0000 7f666ffff6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66640b56e0 0x7f66640d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.326 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.322+0000 7f668effd6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66640b56e0 0x7f66640d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.326 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.322+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7f66780e3c10 con 0x7f6690115410 2026-02-19T21:04:42.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.322+0000 7f668effd6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66640b56e0 0x7f66640d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6684004750 tx=0x7f6684005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.322+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f66780a9430 con 0x7f6690115410 2026-02-19T21:04:42.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.416+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f669011e370 con 0x7f6690115410 2026-02-19T21:04:42.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.417+0000 7f666ffff6c0 1 -- 10.20.193.90:0/77448472 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22760 (secure 0 0 0) 0x7f66780a9610 con 0x7f6690115410 2026-02-19T21:04:42.419 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:42.420 INFO:teuthology.orchestra.run.trial090.stdout:{"epoch":76,"fsid":"34db945f-0dd6-11f1-890f-d404e6e7d460","created":"2026-02-19T21:02:03.870776+0000","modified":"2026-02-19T21:04:41.764093+0000","last_up_change":"2026-02-19T21:04:15.914313+0000","last_in_change":"2026-02-19T21:04:07.215369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-19T21:03:11.280767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-19T21:04:28.620551+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-19T21:04:29.792203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9447a1db-db31-41c0-8732-78156b284c70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6802","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6803","nonce":300222624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6804","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6805","nonce":300222624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6808","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6809","nonce":300222624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6806","nonce":300222624},{"type":"v1","addr":"10.20.193.90:6807","nonce":300222624}]},"public_addr":"10.20.193.90:6803/300222624","cluster_addr":"10.20.193.90:6805/300222624","heartbeat_back_addr":"10.20.193.90:6809/300222624","heartbeat_front_addr":"10.20.193.90:6807/300222624","state":["exists","up"]},{"osd":1,"uuid":"2ceb6ac4-0471-49bc-b664-7b5053f54250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6800","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6801","nonce":515149626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6802","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6803","nonce":515149626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6806","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6807","nonce":515149626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6804","nonce":515149626},{"type":"v1","addr":"10.20.193.105:6805","nonce":515149626}]},"public_addr":"10.20.193.105:6801/515149626","cluster_addr":"10.20.193.105:6803/515149626","heartbeat_back_addr":"10.20.193.105:6807/515149626","heartbeat_front_addr":"10.20.193.105:6805/515149626","state":["exists","up"]},{"osd":2,"uuid":"8ded8050-146f-41a3-a2e7-974118414769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6800","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6801","nonce":2163707084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6802","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6803","nonce":2163707084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6806","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6807","nonce":2163707084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6804","nonce":2163707084},{"type":"v1","addr":"10.20.193.175:6805","nonce":2163707084}]},"public_addr":"10.20.193.175:6801/2163707084","cluster_addr":"10.20.193.175:6803/2163707084","heartbeat_back_addr":"10.20.193.175:6807/2163707084","heartbeat_front_addr":"10.20.193.175:6805/2163707084","state":["exists","up"]},{"osd":3,"uuid":"556df040-373e-4795-af5e-297ede87881b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6810","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6811","nonce":1075832494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6812","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6813","nonce":1075832494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6816","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6817","nonce":1075832494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6814","nonce":1075832494},{"type":"v1","addr":"10.20.193.90:6815","nonce":1075832494}]},"public_addr":"10.20.193.90:6811/1075832494","cluster_addr":"10.20.193.90:6813/1075832494","heartbeat_back_addr":"10.20.193.90:6817/1075832494","heartbeat_front_addr":"10.20.193.90:6815/1075832494","state":["exists","up"]},{"osd":4,"uuid":"a0776450-d439-4c5d-a67d-0ae50bb72319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6808","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6809","nonce":891701520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6810","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6811","nonce":891701520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6814","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6815","nonce":891701520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6812","nonce":891701520},{"type":"v1","addr":"10.20.193.105:6813","nonce":891701520}]},"public_addr":"10.20.193.105:6809/891701520","cluster_addr":"10.20.193.105:6811/891701520","heartbeat_back_addr":"10.20.193.105:6815/891701520","heartbeat_front_addr":"10.20.193.105:6813/891701520","state":["exists","up"]},{"osd":5,"uuid":"3450f832-0b90-45d7-a92d-b74809259564","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6808","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6809","nonce":1433153714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6810","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6811","nonce":1433153714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6814","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6815","nonce":1433153714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6812","nonce":1433153714},{"type":"v1","addr":"10.20.193.175:6813","nonce":1433153714}]},"public_addr":"10.20.193.175:6809/1433153714","cluster_addr":"10.20.193.175:6811/1433153714","heartbeat_back_addr":"10.20.193.175:6815/1433153714","heartbeat_front_addr":"10.20.193.175:6813/1433153714","state":["exists","up"]},{"osd":6,"uuid":"9c8bf4b2-b07f-4ba8-a06d-8c4cf87e42ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6818","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6819","nonce":4121266153}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6820","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6821","nonce":4121266153}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6824","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6825","nonce":4121266153}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6822","nonce":4121266153},{"type":"v1","addr":"10.20.193.90:6823","nonce":4121266153}]},"public_addr":"10.20.193.90:6819/4121266153","cluster_addr":"10.20.193.90:6821/4121266153","heartbeat_back_addr":"10.20.193.90:6825/4121266153","heartbeat_front_addr":"10.20.193.90:6823/4121266153","state":["exists","up"]},{"osd":7,"uuid":"6b119453-b94f-441f-8685-a992fe2922ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6816","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6817","nonce":3597166844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6818","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6819","nonce":3597166844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6822","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6823","nonce":3597166844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6820","nonce":3597166844},{"type":"v1","addr":"10.20.193.105:6821","nonce":3597166844}]},"public_addr":"10.20.193.105:6817/3597166844","cluster_addr":"10.20.193.105:6819/3597166844","heartbeat_back_addr":"10.20.193.105:6823/3597166844","heartbeat_front_addr":"10.20.193.105:6821/3597166844","state":["exists","up"]},{"osd":8,"uuid":"fdfc8889-7eda-48ef-ae9d-5ec9cb798a56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6816","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6817","nonce":711294156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6818","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6819","nonce":711294156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6822","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6823","nonce":711294156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6820","nonce":711294156},{"type":"v1","addr":"10.20.193.175:6821","nonce":711294156}]},"public_addr":"10.20.193.175:6817/711294156","cluster_addr":"10.20.193.175:6819/711294156","heartbeat_back_addr":"10.20.193.175:6823/711294156","heartbeat_front_addr":"10.20.193.175:6821/711294156","state":["exists","up"]},{"osd":9,"uuid":"bfa36c36-03aa-4363-85f7-b4cd9450b612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6826","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6827","nonce":72013082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6828","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6829","nonce":72013082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6832","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6833","nonce":72013082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.90:6830","nonce":72013082},{"type":"v1","addr":"10.20.193.90:6831","nonce":72013082}]},"public_addr":"10.20.193.90:6827/72013082","cluster_addr":"10.20.193.90:6829/72013082","heartbeat_back_addr":"10.20.193.90:6833/72013082","heartbeat_front_addr":"10.20.193.90:6831/72013082","state":["exists","up"]},{"osd":10,"uuid":"43e47e1a-7160-446c-8fe3-8a20cc2a4c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6824","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6825","nonce":3923796147}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6826","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6827","nonce":3923796147}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6830","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6831","nonce":3923796147}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.105:6828","nonce":3923796147},{"type":"v1","addr":"10.20.193.105:6829","nonce":3923796147}]},"public_addr":"10.20.193.105:6825/3923796147","cluster_addr":"10.20.193.105:6827/3923796147","heartbeat_back_addr":"10.20.193.105:6831/3923796147","heartbeat_front_addr":"10.20.193.105:6829/3923796147","state":["exists","up"]},{"osd":11,"uuid":"b789e6a7-be92-4cae-a3a0-d6eebe9b8629","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6824","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6825","nonce":3785438366}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6826","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6827","nonce":3785438366}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6830","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6831","nonce":3785438366}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.175:6828","nonce":3785438366},{"type":"v1","addr":"10.20.193.175:6829","nonce":3785438366}]},"public_addr":"10.20.193.175:6825/3785438366","cluster_addr":"10.20.193.175:6827/3785438366","heartbeat_back_addr":"10.20.193.175:6831/3785438366","heartbeat_front_addr":"10.20.193.175:6829/3785438366","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:02:53.889642+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:00.781533+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:08.187332+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:15.317071+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:22.497099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:29.848931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:37.269086+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:44.452146+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:51.824076+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:03:59.325996+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:06.588398+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-19T21:04:14.010218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.90:0/1864372684":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6800/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1997858222":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/66846304":"2026-02-20T21:02:41.080195+0000","10.20.193.90:6801/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6800/2569638831":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/2504907435":"2026-02-20T21:02:09.876469+0000","10.20.193.90:6801/3416123533":"2026-02-20T21:02:41.080195+0000","10.20.193.90:0/1301435029":"2026-02-20T21:02:09.876469+0000","10.20.193.90:0/4201652812":"2026-02-20T21:02:09.876469+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-19T21:04:42.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66640b56e0 msgr2=0x7f66640d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66640b56e0 0x7f66640d5b90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6684004750 tx=0x7f6684005f10 comp rx=0 tx=0).stop 2026-02-19T21:04:42.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 msgr2=0x7f669011d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f669011d760 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f667800b6c0 tx=0x7f667800bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:42.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 shutdown_connections 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66640b56e0 0x7f66640d5b90 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6690122b20 0x7f6690122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6690115410 0x7f669011d760 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 --2- 10.20.193.90:0/77448472 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f669010f200 0x7f669011d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 >> 10.20.193.90:0/77448472 conn(0x7f66900ecac0 msgr2=0x7f669010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 shutdown_connections 2026-02-19T21:04:42.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.419+0000 7f66952fc6c0 1 -- 10.20.193.90:0/77448472 wait complete. 2026-02-19T21:04:42.461 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-19T21:04:42.461 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-19T21:04:42.462 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-19T21:04:42.463 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-19T21:04:42.463 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-19T21:04:42.464 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-19T21:04:42.464 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-19T21:04:42.464 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-19T21:04:42.465 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-19T21:04:42.466 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-19T21:04:42.466 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-19T21:04:42.466 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-19T21:04:42.612 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.613 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.613 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.614 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.615 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.616 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.616 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.619 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.621 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.623 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.624 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.624 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:42.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 -- 10.20.193.90:0/2888336743 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 msgr2=0x7f2394175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 --2- 10.20.193.90:0/2888336743 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f2394175db0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=2556155987377053266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f238800aa70 tx=0x7f238802fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 -- 10.20.193.90:0/2888336743 shutdown_connections 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 --2- 10.20.193.90:0/2888336743 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f2394175db0 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=2556155987377053266 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 --2- 10.20.193.90:0/2888336743 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f239410fbf0 0x7f2394114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 --2- 10.20.193.90:0/2888336743 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f239410f200 0x7f239410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 -- 10.20.193.90:0/2888336743 >> 10.20.193.90:0/2888336743 conn(0x7f23940ecac0 msgr2=0x7f239410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 -- 10.20.193.90:0/2888336743 shutdown_connections 2026-02-19T21:04:42.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.749+0000 7f239a4546c0 1 -- 10.20.193.90:0/2888336743 wait complete. 2026-02-19T21:04:42.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 Processor -- start 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 -- start start 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f239410f200 0x7f239411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f239411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2394122b90 0x7f2394123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23941235a0 con 0x7f2394115410 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2394123710 con 0x7f239410f200 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f239a4546c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f23941238d0 con 0x7f2394122b90 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f23937fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f239411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f23937fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f239411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43638/0 (socket says 10.20.193.90:43638) 2026-02-19T21:04:42.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f23937fe6c0 1 -- 10.20.193.90:0/1698782492 learned_addr learned my addr 10.20.193.90:0/1698782492 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f2393fff6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f239410f200 0x7f239411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.750+0000 7f23989ca6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2394122b90 0x7f2394123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23937fe6c0 1 -- 10.20.193.90:0/1698782492 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2394122b90 msgr2=0x7f2394123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23937fe6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2394122b90 0x7f2394123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23937fe6c0 1 -- 10.20.193.90:0/1698782492 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f239410f200 msgr2=0x7f239411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23937fe6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f239410f200 0x7f239411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23937fe6c0 1 -- 10.20.193.90:0/1698782492 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238800a660 con 0x7f2394115410 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23937fe6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f239411d7d0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237800b750 tx=0x7f237800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2378004a80 con 0x7f2394115410 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2394163d80 con 0x7f2394115410 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2378009030 con 0x7f2394115410 2026-02-19T21:04:42.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f237800cd00 con 0x7f2394115410 2026-02-19T21:04:42.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2394164210 con 0x7f2394115410 2026-02-19T21:04:42.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.751+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2394052a30 con 0x7f2394115410 2026-02-19T21:04:42.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.753+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f2378005020 con 0x7f2394115410 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.753+0000 7f23917fa6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f236c0b5760 0x7f236c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.753+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7f23780e3c80 con 0x7f2394115410 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f2393fff6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f236c0b5760 0x7f236c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f23917fa6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] conn(0x7f236c0dd230 0x7f236c0fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 --> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f236c0fdd90 con 0x7f236c0dd230 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f23780e40a0 con 0x7f2394115410 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f23989ca6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] conn(0x7f236c0dd230 0x7f236c0fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f2393fff6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f236c0b5760 0x7f236c0d5c10 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2380005fd0 tx=0x7f23800093f0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f23989ca6c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] conn(0x7f236c0dd230 0x7f236c0fd6c0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.754+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== osd.0 v2:10.20.193.90:6802/300222624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f236c0fdd90 con 0x7f236c0dd230 2026-02-19T21:04:42.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/2951380796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f4410fbf0 msgr2=0x7f3f44114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/2951380796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f4410fbf0 0x7f3f44114c30 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=14900568859484592139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f340099a0 tx=0x7f3f3402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:42.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/2951380796 shutdown_connections 2026-02-19T21:04:42.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/2951380796 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3f44115410 0x7f3f44175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/2951380796 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f4410fbf0 0x7f3f44114c30 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=14900568859484592139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/2951380796 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3f4410f200 0x7f3f4410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/2951380796 >> 10.20.193.90:0/2951380796 conn(0x7f3f440ecac0 msgr2=0x7f3f4410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/2951380796 shutdown_connections 2026-02-19T21:04:42.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/2951380796 wait complete. 2026-02-19T21:04:42.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2455308548 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4115410 msgr2=0x7ff5d4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2455308548 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4115410 0x7ff5d4175db0 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=8366059213280827649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d000aa70 tx=0x7ff5d002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2455308548 shutdown_connections 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2455308548 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4115410 0x7ff5d4175db0 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=8366059213280827649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2455308548 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff5d410fbf0 0x7ff5d4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2455308548 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff5d410f200 0x7ff5d410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2455308548 >> 10.20.193.90:0/2455308548 conn(0x7ff5d40ecac0 msgr2=0x7ff5d410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2455308548 shutdown_connections 2026-02-19T21:04:42.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2455308548 wait complete. 2026-02-19T21:04:42.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.762+0000 7f3f4a9c86c0 1 Processor -- start 2026-02-19T21:04:42.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 -- start start 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3f4410f200 0x7f3f440f4cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3f44115410 0x7f3f44175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f440f52e0 0x7f3f440fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3f440f59d0 con 0x7f3f440f52e0 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f440faaa0 con 0x7f3f4410f200 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f4a9c86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3f440fac60 con 0x7f3f44115410 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f440f52e0 0x7f3f440fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f440f52e0 0x7f3f440fa560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43666/0 (socket says 10.20.193.90:43666) 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 -- 10.20.193.90:0/3517464975 learned_addr learned my addr 10.20.193.90:0/3517464975 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f43fff6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3f4410f200 0x7f3f440f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f437fe6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3f44115410 0x7f3f44175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 Processor -- start 2026-02-19T21:04:42.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 -- start start 2026-02-19T21:04:42.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 -- 10.20.193.90:0/3517464975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3f44115410 msgr2=0x7f3f44175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3f44115410 0x7f3f44175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 -- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3f4410f200 msgr2=0x7f3f440f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3f4410f200 0x7f3f440f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 -- 10.20.193.90:0/3517464975 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f34009590 con 0x7f3f440f52e0 2026-02-19T21:04:42.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f437fe6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3f44115410 0x7f3f44175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff5d410f200 0x7ff5d411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff5d4115410 0x7ff5d411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4122b90 0x7ff5d4123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d41235a0 con 0x7ff5d4122b90 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d4123710 con 0x7ff5d4115410 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5db6236c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d41238d0 con 0x7ff5d410f200 2026-02-19T21:04:42.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7f3f48f3e6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f440f52e0 0x7f3f440fa560 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f38006ea0 tx=0x7f3f3800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5d9b956c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4122b90 0x7ff5d4123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5d8b936c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff5d4115410 0x7ff5d411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5d9b956c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4122b90 0x7ff5d4123030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43670/0 (socket says 10.20.193.90:43670) 2026-02-19T21:04:42.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5d9b956c0 1 -- 10.20.193.90:0/2074742530 learned_addr learned my addr 10.20.193.90:0/2074742530 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.763+0000 7ff5d93946c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff5d410f200 0x7ff5d411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d9b956c0 1 -- 10.20.193.90:0/2074742530 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff5d410f200 msgr2=0x7ff5d411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d9b956c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff5d410f200 0x7ff5d411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d9b956c0 1 -- 10.20.193.90:0/2074742530 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff5d4115410 msgr2=0x7ff5d411d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.773 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f38003a30 con 0x7f3f440f52e0 2026-02-19T21:04:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d9b956c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff5d4115410 0x7ff5d411d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d9b956c0 1 -- 10.20.193.90:0/2074742530 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d000a660 con 0x7ff5d4122b90 2026-02-19T21:04:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d93946c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff5d410f200 0x7ff5d411d290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:42.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f440faf40 con 0x7f3f440f52e0 2026-02-19T21:04:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3f380054f0 con 0x7f3f440f52e0 2026-02-19T21:04:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f3800dcd0 con 0x7f3f440f52e0 2026-02-19T21:04:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f440fb6d0 con 0x7f3f440f52e0 2026-02-19T21:04:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5d9b956c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4122b90 0x7ff5d4123030 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d00054b0 tx=0x7ff5d00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f44052a30 con 0x7f3f440f52e0 2026-02-19T21:04:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5d0003c40 con 0x7ff5d4122b90 2026-02-19T21:04:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d4163d20 con 0x7ff5d4122b90 2026-02-19T21:04:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff5d0003da0 con 0x7ff5d4122b90 2026-02-19T21:04:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff5d00382f0 con 0x7ff5d4122b90 2026-02-19T21:04:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.764+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d4164150 con 0x7ff5d4122b90 2026-02-19T21:04:42.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.765+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5d4052a30 con 0x7ff5d4122b90 2026-02-19T21:04:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.765+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 --> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f23941792b0 con 0x7f236c0dd230 2026-02-19T21:04:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.765+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f3f38003b90 con 0x7f3f440f52e0 2026-02-19T21:04:42.777 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f23917fa6c0 1 -- 10.20.193.90:0/1698782492 <== osd.0 v2:10.20.193.90:6802/300222624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f23941792b0 con 0x7f236c0dd230 2026-02-19T21:04:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f3f417fa6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3f180b5760 0x7f3f180d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7f3f380e4c90 con 0x7f3f440f52e0 2026-02-19T21:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f3f43fff6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3f180b5760 0x7f3f180d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f3f417fa6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] conn(0x7f3f180dd220 0x7f3f180fd6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 --> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f180fdd80 con 0x7f3f180dd220 2026-02-19T21:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f3f380e5040 con 0x7f3f440f52e0 2026-02-19T21:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] conn(0x7f236c0dd230 msgr2=0x7f236c0fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f239a4546c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6802/300222624,v1:10.20.193.90:6803/300222624] conn(0x7f236c0dd230 0x7f236c0fd6c0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2805913098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 msgr2=0x7f06e4060ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.766+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2805913098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e4060ab0 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=15910476347876765092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d4009970 tx=0x7f06d402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:42.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f3f437fe6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] conn(0x7f3f180dd220 0x7f3f180fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2805913098 shutdown_connections 2026-02-19T21:04:42.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2805913098 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f06e41556a0 0x7f06e4175a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2805913098 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f06e4060ff0 0x7f06e4155160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2805913098 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e4060ab0 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=15910476347876765092 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f236c0b5760 msgr2=0x7f236c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f236c0b5760 0x7f236c0d5c10 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2380005fd0 tx=0x7f23800093f0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 msgr2=0x7f239411d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 --2- 10.20.193.90:0/1698782492 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2394115410 0x7f239411d7d0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f237800b750 tx=0x7f237800bc20 comp rx=0 tx=0).stop 2026-02-19T21:04:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f23989ca6c0 1 -- 10.20.193.90:0/1698782492 reap_dead start 2026-02-19T21:04:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2805913098 >> 10.20.193.90:0/2805913098 conn(0x7f06e40ea870 msgr2=0x7f06e410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2805913098 shutdown_connections 2026-02-19T21:04:42.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2805913098 wait complete. 2026-02-19T21:04:42.783 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f3f43fff6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3f180b5760 0x7f3f180d5c10 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f30004750 tx=0x7f3f30009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 shutdown_connections 2026-02-19T21:04:42.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 >> 10.20.193.90:0/1698782492 conn(0x7f23940ecac0 msgr2=0x7f239410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 shutdown_connections 2026-02-19T21:04:42.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f239a4546c0 1 -- 10.20.193.90:0/1698782492 wait complete. 2026-02-19T21:04:42.784 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f3f437fe6c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] conn(0x7f3f180dd220 0x7f3f180fd6b0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7ff5d0008260 con 0x7ff5d4122b90 2026-02-19T21:04:42.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 Processor -- start 2026-02-19T21:04:42.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- start start 2026-02-19T21:04:42.785 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/1464752094 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810d960 msgr2=0x7fbf681129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/1464752094 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810d960 0x7fbf681129a0 secure :-1 s=READY pgs=65 gs=3 cs=0 l=1 c_cookie=2218311113010383336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf500099a0 tx=0x7fbf5002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/1464752094 shutdown_connections 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/1464752094 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbf68113180 0x7fbf68173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/1464752094 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810d960 0x7fbf681129a0 unknown :-1 s=CLOSED pgs=65 gs=3 cs=0 l=1 c_cookie=2218311113010383336 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/1464752094 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6810cf70 0x7fbf6810d340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/1464752094 >> 10.20.193.90:0/1464752094 conn(0x7fbf680ea870 msgr2=0x7fbf6810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.786 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/1464752094 shutdown_connections 2026-02-19T21:04:42.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e41615c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.787 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/1464752094 wait complete. 2026-02-19T21:04:42.788 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f06e4060ff0 0x7f06e4161b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.788 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f06e41556a0 0x7f06e4166ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.788 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4167510 con 0x7f06e40606e0 2026-02-19T21:04:42.788 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4167680 con 0x7f06e4060ff0 2026-02-19T21:04:42.788 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06ec0806c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06e4167840 con 0x7f06e41556a0 2026-02-19T21:04:42.788 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06e9df56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e41615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.789 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.767+0000 7f06e9df56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e41615c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43694/0 (socket says 10.20.193.90:43694) 2026-02-19T21:04:42.789 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 -- 10.20.193.90:0/2429821936 learned_addr learned my addr 10.20.193.90:0/2429821936 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.789 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e95f46c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f06e4060ff0 0x7f06e4161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.789 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06ea5f66c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f06e41556a0 0x7f06e4166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.789 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== osd.7 v2:10.20.193.105:6816/3597166844 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f3f180fdd80 con 0x7f3f180dd220 2026-02-19T21:04:42.790 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5c27fc6c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff5b00b56e0 0x7ff5b00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.790 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 Processor -- start 2026-02-19T21:04:42.790 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 -- 10.20.193.90:0/2429821936 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f06e41556a0 msgr2=0x7f06e4166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 -- start start 2026-02-19T21:04:42.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f06e41556a0 0x7f06e4166ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 -- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f06e4060ff0 msgr2=0x7f06e4161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f06e4060ff0 0x7f06e4161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.791 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 -- 10.20.193.90:0/2429821936 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4009590 con 0x7f06e40606e0 2026-02-19T21:04:42.792 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5d93946c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff5b00b56e0 0x7ff5b00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.792 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06e9df56c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e41615c0 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d40092b0 tx=0x7f06d402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.792 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7ff5d0109180 con 0x7ff5d4122b90 2026-02-19T21:04:42.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810cf70 0x7fbf68117730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbf68113180 0x7fbf68117c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6811d030 0x7fbf6811d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6811da40 con 0x7fbf6811d030 2026-02-19T21:04:42.793 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6811dbb0 con 0x7fbf68113180 2026-02-19T21:04:42.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf6d4b46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6811dd70 con 0x7fbf6810cf70 2026-02-19T21:04:42.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5c27fc6c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] conn(0x7ff5b00dd1b0 0x7ff5b00fd640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 --> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5b00fdd10 con 0x7ff5b00dd1b0 2026-02-19T21:04:42.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff5d0109530 con 0x7ff5d4122b90 2026-02-19T21:04:42.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6811d030 0x7fbf6811d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.795 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5d93946c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff5b00b56e0 0x7ff5b00d5b90 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5c4004750 tx=0x7ff5c4005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.795 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6811d030 0x7fbf6811d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43696/0 (socket says 10.20.193.90:43696) 2026-02-19T21:04:42.795 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 -- 10.20.193.90:0/310725830 learned_addr learned my addr 10.20.193.90:0/310725830 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.795 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7ff5d8b936c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] conn(0x7ff5b00dd1b0 0x7ff5b00fd640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06d4002ba0 con 0x7f06e40606e0 2026-02-19T21:04:42.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e4167ac0 con 0x7f06e40606e0 2026-02-19T21:04:42.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f06d4007680 con 0x7f06e40606e0 2026-02-19T21:04:42.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06d4002ba0 con 0x7f06e40606e0 2026-02-19T21:04:42.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41512d0 con 0x7f06e40606e0 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf667fc6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbf68113180 0x7fbf68117c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf66ffd6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810cf70 0x7fbf68117730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 -- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810cf70 msgr2=0x7fbf68117730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810cf70 0x7fbf68117730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 -- 10.20.193.90:0/310725830 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbf68113180 msgr2=0x7fbf68117c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbf68113180 0x7fbf68117c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 -- 10.20.193.90:0/310725830 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf50009590 con 0x7fbf6811d030 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf667fc6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbf68113180 0x7fbf68117c70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:42.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf66ffd6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbf6810cf70 0x7fbf68117730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:42.798 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.768+0000 7fbf677fe6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6811d030 0x7fbf6811d4d0 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf58006ea0 tx=0x7fbf5800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.798 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7ff5d8b936c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] conn(0x7ff5b00dd1b0 0x7ff5b00fd640 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.798 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06e4052a30 con 0x7f06e40606e0 2026-02-19T21:04:42.798 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== osd.6 v2:10.20.193.90:6818/4121266153 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7ff5b00fdd10 con 0x7ff5b00dd1b0 2026-02-19T21:04:42.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf58003c40 con 0x7fbf6811d030 2026-02-19T21:04:42.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf6815e220 con 0x7fbf6811d030 2026-02-19T21:04:42.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbf58003da0 con 0x7fbf6811d030 2026-02-19T21:04:42.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf580081c0 con 0x7fbf6811d030 2026-02-19T21:04:42.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.769+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf6815e6b0 con 0x7fbf6811d030 2026-02-19T21:04:42.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf68052a30 con 0x7fbf6811d030 2026-02-19T21:04:42.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 -- 10.20.193.90:0/1027012844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 msgr2=0x7fdec810c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 --2- 10.20.193.90:0/1027012844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec810c980 secure :-1 s=READY pgs=261 gs=2 cs=0 l=1 c_cookie=8179847189819309819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdebc00aa40 tx=0x7fdebc02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f06d4002d00 con 0x7f06e40606e0 2026-02-19T21:04:42.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 -- 10.20.193.90:0/1027012844 shutdown_connections 2026-02-19T21:04:42.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 --2- 10.20.193.90:0/1027012844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec810c980 unknown :-1 s=CLOSED pgs=261 gs=2 cs=0 l=1 c_cookie=8179847189819309819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 --2- 10.20.193.90:0/1027012844 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdec8112fc0 0x7fdec810b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 --2- 10.20.193.90:0/1027012844 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdec8112b10 0x7fdec810b1f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.770+0000 7fdecea616c0 1 -- 10.20.193.90:0/1027012844 >> 10.20.193.90:0/1027012844 conn(0x7fdec8063a80 msgr2=0x7fdec8064270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 -- 10.20.193.90:0/1027012844 shutdown_connections 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 -- 10.20.193.90:0/1027012844 wait complete. 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fbf58005030 con 0x7fbf6811d030 2026-02-19T21:04:42.801 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 Processor -- start 2026-02-19T21:04:42.802 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 -- start start 2026-02-19T21:04:42.802 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7f06d2ffd6c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f06c00b57c0 0x7f06c00d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.802 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec8122d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.802 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdec8112b10 0x7fdec8123280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.802 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdec8112fc0 0x7fdec81285f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.803 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7f06e95f46c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f06c00b57c0 0x7f06c00d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.803 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8128c40 con 0x7fdec810c4e0 2026-02-19T21:04:42.803 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8128db0 con 0x7fdec8112fc0 2026-02-19T21:04:42.803 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdecea616c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdec8128f70 con 0x7fdec8112b10 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdec7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec8122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdec77fe6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdec8112b10 0x7fdec8123280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdeccfd36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdec8112fc0 0x7fdec81285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdeccfd36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdec8112fc0 0x7fdec81285f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:40662/0 (socket says 10.20.193.90:40662) 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdec7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec8122d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43708/0 (socket says 10.20.193.90:43708) 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7fdeccfd36c0 1 -- 10.20.193.90:0/2910754029 learned_addr learned my addr 10.20.193.90:0/2910754029 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.771+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7f06d41079f0 con 0x7f06e40606e0 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7f06d2ffd6c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] conn(0x7f06c00dd290 0x7f06c00fd720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 --> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06c00fddf0 con 0x7f06c00dd290 2026-02-19T21:04:42.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f06d4107da0 con 0x7f06e40606e0 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec7fff6c0 1 -- 10.20.193.90:0/2910754029 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdec8112b10 msgr2=0x7fdec8123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec7fff6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdec8112b10 0x7fdec8123280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec7fff6c0 1 -- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdec8112fc0 msgr2=0x7fdec81285f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec7fff6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdec8112fc0 0x7fdec81285f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec7fff6c0 1 -- 10.20.193.90:0/2910754029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdebc00a660 con 0x7fdec810c4e0 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7f06e95f46c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f06c00b57c0 0x7f06c00d5c70 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e4167f50 tx=0x7f06d8009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.805 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf47fff6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbf3c0b5760 0x7fbf3c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.806 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec7fff6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec8122d40 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdeb400b6c0 tx=0x7fdeb400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.806 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7f06ea5f66c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] conn(0x7f06c00dd290 0x7f06c00fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.806 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdeb4004240 con 0x7fdec810c4e0 2026-02-19T21:04:42.806 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdeb4009030 con 0x7fdec810c4e0 2026-02-19T21:04:42.806 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec8129250 con 0x7fdec810c4e0 2026-02-19T21:04:42.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf66ffd6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbf3c0b5760 0x7fbf3c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8209+0+0 (secure 0 0 0) 0x7fbf580e4ee0 con 0x7fbf6811d030 2026-02-19T21:04:42.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdeb40036e0 con 0x7fdec810c4e0 2026-02-19T21:04:42.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec8169930 con 0x7fdec810c4e0 2026-02-19T21:04:42.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf47fff6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] conn(0x7fbf3c0dd230 0x7fbf3c0fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 --> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf3c0fdd90 con 0x7fbf3c0dd230 2026-02-19T21:04:42.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fbf580e5290 con 0x7fbf6811d030 2026-02-19T21:04:42.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.773+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdec8052a30 con 0x7fdec810c4e0 2026-02-19T21:04:42.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.772+0000 7fbf667fc6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] conn(0x7fbf3c0dd230 0x7fbf3c0fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.773+0000 7fbf66ffd6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbf3c0b5760 0x7fbf3c0d5c10 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5c004750 tx=0x7fbf5c006e70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.773+0000 7f06ea5f66c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] conn(0x7f06c00dd290 0x7f06c00fd720 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.773+0000 7fbf667fc6c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] conn(0x7fbf3c0dd230 0x7fbf3c0fd6c0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.774+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== osd.2 v2:10.20.193.175:6800/2163707084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fbf3c0fdd90 con 0x7fbf3c0dd230 2026-02-19T21:04:42.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.774+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== osd.4 v2:10.20.193.105:6808/891701520 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f06c00fddf0 con 0x7f06c00dd290 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 -- 10.20.193.90:0/955318157 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb868113d80 msgr2=0x7fb868114150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/955318157 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb868113d80 0x7fb868114150 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=336657177766066527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c009970 tx=0x7fb85c02ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 -- 10.20.193.90:0/955318157 shutdown_connections 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/955318157 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb86815bfb0 0x7fb86817c390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/955318157 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb868114690 0x7fb86815ba70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/955318157 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb868113d80 0x7fb868114150 unknown :-1 s=CLOSED pgs=67 gs=2 cs=0 l=1 c_cookie=336657177766066527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 -- 10.20.193.90:0/955318157 >> 10.20.193.90:0/955318157 conn(0x7fb8680589f0 msgr2=0x7fb868058df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 -- 10.20.193.90:0/955318157 shutdown_connections 2026-02-19T21:04:42.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.775+0000 7fb86ce796c0 1 -- 10.20.193.90:0/955318157 wait complete. 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 Processor -- start 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 -- start start 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb868113d80 0x7fb868108bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb868114690 0x7fb868109100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb86815bfb0 0x7fb86810df60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb86810e520 con 0x7fb868114690 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb86810e690 con 0x7fb86815bfb0 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb86ce796c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb86810e850 con 0x7fb868113d80 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb866d766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb86815bfb0 0x7fb86810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb865d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb868114690 0x7fb868109100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb8665756c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb868113d80 0x7fb868108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb865d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb868114690 0x7fb868109100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43744/0 (socket says 10.20.193.90:43744) 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb865d746c0 1 -- 10.20.193.90:0/1185270049 learned_addr learned my addr 10.20.193.90:0/1185270049 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7fb8665756c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb868113d80 0x7fb868108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:37974/0 (socket says 10.20.193.90:37974) 2026-02-19T21:04:42.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7f646236f6c0 1 -- 10.20.193.90:0/982431991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 msgr2=0x7f645c10be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.776+0000 7f646236f6c0 1 --2- 10.20.193.90:0/982431991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c10be20 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=3762122207570942400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6448009970 tx=0x7f644802ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb866d766c0 1 -- 10.20.193.90:0/1185270049 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb868113d80 msgr2=0x7fb868108bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb866d766c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb868113d80 0x7fb868108bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb866d766c0 1 -- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb868114690 msgr2=0x7fb868109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb866d766c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb868114690 0x7fb868109100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb866d766c0 1 -- 10.20.193.90:0/1185270049 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c009590 con 0x7fb86815bfb0 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 -- 10.20.193.90:0/982431991 shutdown_connections 2026-02-19T21:04:42.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 --2- 10.20.193.90:0/982431991 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f645c155780 0x7f645c175b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 --2- 10.20.193.90:0/982431991 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f645c10c360 0x7f645c155240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 --2- 10.20.193.90:0/982431991 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c10be20 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=3762122207570942400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 -- 10.20.193.90:0/982431991 >> 10.20.193.90:0/982431991 conn(0x7f645c0e96f0 msgr2=0x7f645c109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 -- 10.20.193.90:0/982431991 shutdown_connections 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7f646236f6c0 1 -- 10.20.193.90:0/982431991 wait complete. 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb866d766c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb86815bfb0 0x7fb86810df60 secure :-1 s=READY pgs=69 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb868115750 tx=0x7fb85800cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.777+0000 7fb865d746c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb868114690 0x7fb868109100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 Processor -- start 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 -- 10.20.193.90:0/1682555308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8e3010ba30 msgr2=0x7f8e3010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/1682555308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8e3010ba30 0x7f8e3010be00 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=7649145489646544756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e240098a0 tx=0x7f8e2402ec40 comp rx=0 tx=0).stop 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 -- start start 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fdeb4003870 con 0x7fdec810c4e0 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 -- 10.20.193.90:0/1682555308 shutdown_connections 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/1682555308 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8e30155760 0x7f8e30175b40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/1682555308 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010c340 0x7f8e30155220 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/1682555308 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8e3010ba30 0x7f8e3010be00 unknown :-1 s=CLOSED pgs=68 gs=2 cs=0 l=1 c_cookie=7649145489646544756 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 -- 10.20.193.90:0/1682555308 >> 10.20.193.90:0/1682555308 conn(0x7f8e300e9710 msgr2=0x7f8e30109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 -- 10.20.193.90:0/1682555308 shutdown_connections 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c168f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f645c10c360 0x7f645c1694b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f645c155780 0x7f645c16e870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f645c16ee30 con 0x7f645c10ba50 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f645c16efa0 con 0x7f645c155780 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f646236f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f645c16f160 con 0x7f645c10c360 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f645bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c168f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 --> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f44179230 con 0x7f3f180dd220 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f645b7fe6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f645c10c360 0x7f645c1694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f645bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c168f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43756/0 (socket says 10.20.193.90:43756) 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f645bfff6c0 1 -- 10.20.193.90:0/3303280316 learned_addr learned my addr 10.20.193.90:0/3303280316 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 -- 10.20.193.90:0/1682555308 wait complete. 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f64608e16c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f645c155780 0x7f645c16e870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7f8e34a646c0 1 Processor -- start 2026-02-19T21:04:42.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8580054a0 con 0x7fb86815bfb0 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86810eb30 con 0x7fb86815bfb0 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb85800a030 con 0x7fb86815bfb0 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb85800db50 con 0x7fb86815bfb0 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb86810f280 con 0x7fb86815bfb0 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f417fa6c0 1 -- 10.20.193.90:0/3517464975 <== osd.7 v2:10.20.193.105:6816/3597166844 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3f44179230 con 0x7f3f180dd220 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645b7fe6c0 1 -- 10.20.193.90:0/3303280316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f645c155780 msgr2=0x7f645c16e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645b7fe6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f645c155780 0x7f645c16e870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645b7fe6c0 1 -- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 msgr2=0x7f645c168f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645b7fe6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c168f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 -- start start 2026-02-19T21:04:42.818 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.778+0000 7fdec57fa6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde9c0b57e0 0x7fde9c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.818 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645b7fe6c0 1 -- 10.20.193.90:0/3303280316 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6448009590 con 0x7f645c10c360 2026-02-19T21:04:42.818 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdec77fe6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde9c0b57e0 0x7fde9c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.818 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645bfff6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f645c10ba50 0x7f645c168f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:42.818 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdeb40e3c30 con 0x7fdec810c4e0 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010ba30 0x7f8e300eda00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f64608e16c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f645c155780 0x7f645c16e870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f645b7fe6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f645c10c360 0x7f645c1694b0 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c00b6c0 tx=0x7f644c00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8e3010c340 0x7f8e300edf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8e30155760 0x7f8e300f3300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e300f3950 con 0x7f8e3010ba30 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e300f3ac0 con 0x7f8e30155760 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e34a646c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8e300f3c80 con 0x7f8e3010c340 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010ba30 0x7f8e300eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010ba30 0x7f8e300eda00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43766/0 (socket says 10.20.193.90:43766) 2026-02-19T21:04:42.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 -- 10.20.193.90:0/2316429276 learned_addr learned my addr 10.20.193.90:0/2316429276 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdec57fa6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] conn(0x7fde9c0dd2b0 0x7fde9c0fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 --> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde9c0fde10 con 0x7fde9c0dd2b0 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdeb40e3f60 con 0x7fdec810c4e0 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c004560 con 0x7f645c10c360 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2dd746c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8e3010c340 0x7f8e300edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645c16f440 con 0x7f645c10c360 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 -- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8e3010c340 msgr2=0x7f8e300edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8e3010c340 0x7f8e300edf40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 -- 10.20.193.90:0/2316429276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8e30155760 msgr2=0x7f8e300f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8e30155760 0x7f8e300f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 -- 10.20.193.90:0/2316429276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240094c0 con 0x7f8e3010ba30 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdeccfd36c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] conn(0x7fde9c0dd2b0 0x7fde9c0fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645c16fb90 con 0x7f645c10c360 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f644c009030 con 0x7f645c10c360 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f644c00cb50 con 0x7f645c10c360 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2dd746c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8e3010c340 0x7f8e300edf40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] conn(0x7f3f180dd220 msgr2=0x7f3f180fd6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.105:6816/3597166844,v1:10.20.193.105:6817/3597166844] conn(0x7f3f180dd220 0x7f3f180fd6b0 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.821 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3f180b5760 msgr2=0x7f3f180d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3f180b5760 0x7f3f180d5c10 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f30004750 tx=0x7f3f30009260 comp rx=0 tx=0).stop 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f440f52e0 msgr2=0x7f3f440fa560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 --2- 10.20.193.90:0/3517464975 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3f440f52e0 0x7f3f440fa560 secure :-1 s=READY pgs=256 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f38006ea0 tx=0x7f3f3800cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdec77fe6c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde9c0b57e0 0x7fde9c0d5c90 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdec8129680 tx=0x7fdeb8009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f48f3e6c0 1 -- 10.20.193.90:0/3517464975 reap_dead start 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 shutdown_connections 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 >> 10.20.193.90:0/3517464975 conn(0x7f3f440ecac0 msgr2=0x7f3f4410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7fdeccfd36c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] conn(0x7fde9c0dd2b0 0x7fde9c0fd740 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.822 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f8e2e5756c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010ba30 0x7f8e300eda00 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e24005910 tx=0x7f8e2402fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb868052a30 con 0x7fb86815bfb0 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f645c052a30 con 0x7f645c10c360 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 --> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5d4179300 con 0x7ff5b00dd1b0 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e24002ae0 con 0x7f8e3010ba30 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.779+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 shutdown_connections 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f3f4a9c86c0 1 -- 10.20.193.90:0/3517464975 wait complete. 2026-02-19T21:04:42.823 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== osd.10 v2:10.20.193.105:6824/3923796147 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fde9c0fde10 con 0x7fde9c0dd2b0 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e300f3f00 con 0x7f8e3010ba30 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301523a0 con 0x7f8e3010ba30 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8e24007680 con 0x7f8e3010ba30 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7ff5c27fc6c0 1 -- 10.20.193.90:0/2074742530 <== osd.6 v2:10.20.193.90:6818/4121266153 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff5d4179300 con 0x7ff5b00dd1b0 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8e24031340 con 0x7f8e3010ba30 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 -- 10.20.193.90:0/2498739499 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 msgr2=0x7f7df010c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/2498739499 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 0x7f7df010c1e0 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=9305854881391640314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7de000aa40 tx=0x7f7de002fdf0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 -- 10.20.193.90:0/2498739499 shutdown_connections 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/2498739499 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7df0112020 0x7f7df01729c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/2498739499 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df010c800 0x7f7df0111840 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/2498739499 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 0x7f7df010c1e0 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=9305854881391640314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 -- 10.20.193.90:0/2498739499 >> 10.20.193.90:0/2498739499 conn(0x7f7df00e96d0 msgr2=0x7f7df0109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.780+0000 7f7df71e06c0 1 -- 10.20.193.90:0/2498739499 shutdown_connections 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] conn(0x7ff5b00dd1b0 msgr2=0x7ff5b00fd640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6818/4121266153,v1:10.20.193.90:6819/4121266153] conn(0x7ff5b00dd1b0 0x7ff5b00fd640 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fb85800dd00 con 0x7fb86815bfb0 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff5b00b56e0 msgr2=0x7ff5b00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff5b00b56e0 0x7ff5b00d5b90 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5c4004750 tx=0x7ff5c4005f10 comp rx=0 tx=0).stop 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4122b90 msgr2=0x7ff5d4123030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 --2- 10.20.193.90:0/2074742530 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff5d4122b90 0x7ff5d4123030 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff5d00054b0 tx=0x7ff5d00054e0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5d9b956c0 1 -- 10.20.193.90:0/2074742530 reap_dead start 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e30052a30 con 0x7f8e3010ba30 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 shutdown_connections 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 >> 10.20.193.90:0/2074742530 conn(0x7ff5d40ecac0 msgr2=0x7ff5d410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 shutdown_connections 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7ff5db6236c0 1 -- 10.20.193.90:0/2074742530 wait complete. 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f644c00cd20 con 0x7f645c10c360 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 -- 10.20.193.90:0/2498739499 wait complete. 2026-02-19T21:04:42.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 Processor -- start 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7fb84f7fe6c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb8400b58b0 0x7fb8400d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fb8580e4a10 con 0x7fb86815bfb0 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 -- start start 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7fb8665756c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb8400b58b0 0x7fb8400d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7fb84f7fe6c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] conn(0x7fb8400dd380 0x7fb8400fd810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 --> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8400fdee0 con 0x7fb8400dd380 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fb8580e8070 con 0x7fb86815bfb0 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 0x7f7df0119e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df0112020 0x7f7df011a3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7df011f780 0x7f7df011fc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0120190 con 0x7f7df011f780 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0120300 con 0x7f7df0112020 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.781+0000 7f7df71e06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7df01204c0 con 0x7f7df010be10 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df0112020 0x7f7df011a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df0112020 0x7f7df011a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:40726/0 (socket says 10.20.193.90:40726) 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 -- 10.20.193.90:0/3676793220 learned_addr learned my addr 10.20.193.90:0/3676793220 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7fb865d746c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] conn(0x7fb8400dd380 0x7fb8400fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7fb8665756c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb8400b58b0 0x7fb8400d5d60 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c0098c0 tx=0x7fb85c0023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7df4f556c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 0x7f7df0119e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7df57566c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7df011f780 0x7f7df011fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7fb865d746c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] conn(0x7fb8400dd380 0x7fb8400fd810 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f64597fa6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f64300b5760 0x7f64300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 -- 10.20.193.90:0/3676793220 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 msgr2=0x7f7df0119e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 0x7f7df0119e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 -- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7df011f780 msgr2=0x7f7df011fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7df011f780 0x7f7df011fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 -- 10.20.193.90:0/3676793220 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dec0094c0 con 0x7f7df0112020 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7df4f556c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7df010be10 0x7f7df0119e80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7df57566c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7df011f780 0x7f7df011fc20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f644c0e3b40 con 0x7f645c10c360 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f645bfff6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f64300b5760 0x7f64300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de7fff6c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df0112020 0x7f7df011a3c0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dd8005fd0 tx=0x7f7dd800bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dd8004280 con 0x7f7df0112020 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7dd80043e0 con 0x7f7df0112020 2026-02-19T21:04:42.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de000a660 con 0x7f7df0112020 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f64597fa6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] conn(0x7f64300dd230 0x7f64300fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 --> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64300fdd90 con 0x7f64300dd230 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f644c0e3ef0 con 0x7f645c10c360 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f645bfff6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f64300b5760 0x7f64300d5c10 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64480023e0 tx=0x7f6448005ae0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7dd800ccd0 con 0x7f7df0112020 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df0160cc0 con 0x7f7df0112020 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.782+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f8e24002c60 con 0x7f8e3010ba30 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== osd.3 v2:10.20.193.90:6810/1075832494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fb8400fdee0 con 0x7fb8400dd380 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f64608e16c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] conn(0x7f64300dd230 0x7f64300fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.830 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7df0052a30 con 0x7f7df0112020 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e177fe6c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8e080b57e0 0x7f8e080d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f8e24107f00 con 0x7f8e3010ba30 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e2dd746c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8e080b57e0 0x7f8e080d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e177fe6c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] conn(0x7f8e080dd2b0 0x7f8e080fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 --> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e080fde10 con 0x7f8e080dd2b0 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f8e24108230 con 0x7f8e3010ba30 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f64608e16c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] conn(0x7f64300dd230 0x7f64300fd6c0 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e2ed766c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] conn(0x7f8e080dd2b0 0x7f8e080fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.783+0000 7f8e2dd746c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8e080b57e0 0x7f8e080d5c90 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e300f4390 tx=0x7f8e18009310 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.784+0000 7f8e2ed766c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] conn(0x7f8e080dd2b0 0x7f8e080fd740 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.831 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.784+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== osd.11 v2:10.20.193.175:6824/3785438366 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f64300fdd90 con 0x7f64300dd230 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.784+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 --> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf68062360 con 0x7fbf3c0dd230 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.784+0000 7fbf47fff6c0 1 -- 10.20.193.90:0/310725830 <== osd.2 v2:10.20.193.175:6800/2163707084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbf68062360 con 0x7fbf3c0dd230 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.784+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f7dd80026b0 con 0x7f7df0112020 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.784+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== osd.5 v2:10.20.193.175:6808/1433153714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f8e080fde10 con 0x7f8e080dd2b0 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] conn(0x7fbf3c0dd230 msgr2=0x7fbf3c0fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.175:6800/2163707084,v1:10.20.193.175:6801/2163707084] conn(0x7fbf3c0dd230 0x7fbf3c0fd6c0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbf3c0b5760 msgr2=0x7fbf3c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbf3c0b5760 0x7fbf3c0d5c10 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf5c004750 tx=0x7fbf5c006e70 comp rx=0 tx=0).stop 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6811d030 msgr2=0x7fbf6811d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 --2- 10.20.193.90:0/310725830 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbf6811d030 0x7fbf6811d4d0 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf58006ea0 tx=0x7fbf5800ce50 comp rx=0 tx=0).stop 2026-02-19T21:04:42.832 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf677fe6c0 1 -- 10.20.193.90:0/310725830 reap_dead start 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7f7de5ffb6c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7dcc0b5760 0x7f7dcc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7f7df4f556c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7dcc0b5760 0x7f7dcc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f7dd80e3de0 con 0x7f7df0112020 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 shutdown_connections 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 >> 10.20.193.90:0/310725830 conn(0x7fbf680ea870 msgr2=0x7fbf6810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 shutdown_connections 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.785+0000 7fbf6d4b46c0 1 -- 10.20.193.90:0/310725830 wait complete. 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f7de5ffb6c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] conn(0x7f7dcc0dd230 0x7f7dcc0fd6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 --> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7dcc0fdd90 con 0x7f7dcc0dd230 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f7dd80e4200 con 0x7f7df0112020 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 --> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06e404cc30 con 0x7f06c00dd290 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f7df4f556c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7dcc0b5760 0x7f7dcc0d5c10 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7de00024b0 tx=0x7f7de000a240 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f7df57566c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] conn(0x7f7dcc0dd230 0x7f7dcc0fd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06d2ffd6c0 1 -- 10.20.193.90:0/2429821936 <== osd.4 v2:10.20.193.105:6808/891701520 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f06e404cc30 con 0x7f06c00dd290 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] conn(0x7f06c00dd290 msgr2=0x7f06c00fd720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.105:6808/891701520,v1:10.20.193.105:6809/891701520] conn(0x7f06c00dd290 0x7f06c00fd720 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f06c00b57c0 msgr2=0x7f06c00d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f06c00b57c0 0x7f06c00d5c70 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e4167f50 tx=0x7f06d8009390 comp rx=0 tx=0).stop 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 msgr2=0x7f06e41615c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ec0806c0 1 --2- 10.20.193.90:0/2429821936 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f06e40606e0 0x7f06e41615c0 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d40092b0 tx=0x7f06d402fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.786+0000 7f06ea5f66c0 1 -- 10.20.193.90:0/2429821936 reap_dead start 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.787+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 shutdown_connections 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.787+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 >> 10.20.193.90:0/2429821936 conn(0x7f06e40ea870 msgr2=0x7f06e410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.787+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 shutdown_connections 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.787+0000 7f06ec0806c0 1 -- 10.20.193.90:0/2429821936 wait complete. 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.788+0000 7f7df57566c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] conn(0x7f7dcc0dd230 0x7f7dcc0fd6c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.789+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== osd.1 v2:10.20.193.105:6800/515149626 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f7dcc0fdd90 con 0x7f7dcc0dd230 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 --> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdec810e750 con 0x7fde9c0dd2b0 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdec57fa6c0 1 -- 10.20.193.90:0/2910754029 <== osd.10 v2:10.20.193.105:6824/3923796147 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdec810e750 con 0x7fde9c0dd2b0 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] conn(0x7fde9c0dd2b0 msgr2=0x7fde9c0fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.105:6824/3923796147,v1:10.20.193.105:6825/3923796147] conn(0x7fde9c0dd2b0 0x7fde9c0fd740 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde9c0b57e0 msgr2=0x7fde9c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde9c0b57e0 0x7fde9c0d5c90 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdec8129680 tx=0x7fdeb8009260 comp rx=0 tx=0).stop 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 msgr2=0x7fdec8122d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdecea616c0 1 --2- 10.20.193.90:0/2910754029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdec810c4e0 0x7fdec8122d40 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdeb400b6c0 tx=0x7fdeb400bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.790+0000 7fdeccfd36c0 1 -- 10.20.193.90:0/2910754029 reap_dead start 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.791+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 shutdown_connections 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.791+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 >> 10.20.193.90:0/2910754029 conn(0x7fdec8063a80 msgr2=0x7fdec810b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.791+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 shutdown_connections 2026-02-19T21:04:42.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.791+0000 7fdecea616c0 1 -- 10.20.193.90:0/2910754029 wait complete. 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.791+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 --> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8680ff870 con 0x7fb8400dd380 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb84f7fe6c0 1 -- 10.20.193.90:0/1185270049 <== osd.3 v2:10.20.193.90:6810/1075832494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb8680ff870 con 0x7fb8400dd380 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] conn(0x7fb8400dd380 msgr2=0x7fb8400fd810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6810/1075832494,v1:10.20.193.90:6811/1075832494] conn(0x7fb8400dd380 0x7fb8400fd810 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 --> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f645c15b7c0 con 0x7f64300dd230 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb8400b58b0 msgr2=0x7fb8400d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb8400b58b0 0x7fb8400d5d60 secure :-1 s=READY pgs=159 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85c0098c0 tx=0x7fb85c0023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb86815bfb0 msgr2=0x7fb86810df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb86ce796c0 1 --2- 10.20.193.90:0/1185270049 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb86815bfb0 0x7fb86810df60 secure :-1 s=READY pgs=69 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb868115750 tx=0x7fb85800cb60 comp rx=0 tx=0).stop 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7fb866d766c0 1 -- 10.20.193.90:0/1185270049 reap_dead start 2026-02-19T21:04:42.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.792+0000 7f64597fa6c0 1 -- 10.20.193.90:0/3303280316 <== osd.11 v2:10.20.193.175:6824/3785438366 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f645c15b7c0 con 0x7f64300dd230 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 shutdown_connections 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 >> 10.20.193.90:0/1185270049 conn(0x7fb8680589f0 msgr2=0x7fb8680fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 shutdown_connections 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7fb86ce796c0 1 -- 10.20.193.90:0/1185270049 wait complete. 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] conn(0x7f64300dd230 msgr2=0x7f64300fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:6824/3785438366,v1:10.20.193.175:6825/3785438366] conn(0x7f64300dd230 0x7f64300fd6c0 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f64300b5760 msgr2=0x7f64300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f64300b5760 0x7f64300d5c10 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64480023e0 tx=0x7f6448005ae0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f645c10c360 msgr2=0x7f645c1694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 --2- 10.20.193.90:0/3303280316 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f645c10c360 0x7f645c1694b0 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f644c00b6c0 tx=0x7f644c00bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f64608e16c0 1 -- 10.20.193.90:0/3303280316 reap_dead start 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 shutdown_connections 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 >> 10.20.193.90:0/3303280316 conn(0x7f645c0e96f0 msgr2=0x7f645c109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 shutdown_connections 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.793+0000 7f646236f6c0 1 -- 10.20.193.90:0/3303280316 wait complete. 2026-02-19T21:04:42.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.794+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 --> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8e3005d050 con 0x7f8e080dd2b0 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.794+0000 7f8e177fe6c0 1 -- 10.20.193.90:0/2316429276 <== osd.5 v2:10.20.193.175:6808/1433153714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8e3005d050 con 0x7f8e080dd2b0 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] conn(0x7f8e080dd2b0 msgr2=0x7f8e080fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.175:6808/1433153714,v1:10.20.193.175:6809/1433153714] conn(0x7f8e080dd2b0 0x7f8e080fd740 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8e080b57e0 msgr2=0x7f8e080d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f8e080b57e0 0x7f8e080d5c90 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e300f4390 tx=0x7f8e18009310 comp rx=0 tx=0).stop 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010ba30 msgr2=0x7f8e300eda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 --2- 10.20.193.90:0/2316429276 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8e3010ba30 0x7f8e300eda00 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8e24005910 tx=0x7f8e2402fb20 comp rx=0 tx=0).stop 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e2ed766c0 1 -- 10.20.193.90:0/2316429276 reap_dead start 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 shutdown_connections 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 >> 10.20.193.90:0/2316429276 conn(0x7f8e300e9710 msgr2=0x7f8e3005c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 shutdown_connections 2026-02-19T21:04:42.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.795+0000 7f8e34a646c0 1 -- 10.20.193.90:0/2316429276 wait complete. 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 -- 10.20.193.90:0/3788345979 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce410fbf0 msgr2=0x7fdce4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/3788345979 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce410fbf0 0x7fdce4114c30 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=17866037703078349130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd80099a0 tx=0x7fdcd802ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 -- 10.20.193.90:0/3788345979 shutdown_connections 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/3788345979 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdce4115410 0x7fdce4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/3788345979 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce410fbf0 0x7fdce4114c30 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=17866037703078349130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/3788345979 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdce410f200 0x7fdce410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 -- 10.20.193.90:0/3788345979 >> 10.20.193.90:0/3788345979 conn(0x7fdce40ecac0 msgr2=0x7fdce410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 -- 10.20.193.90:0/3788345979 shutdown_connections 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 -- 10.20.193.90:0/3788345979 wait complete. 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 Processor -- start 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.796+0000 7fdceb6196c0 1 -- start start 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdceb6196c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdce410f200 0x7fdce40666a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdceb6196c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdce4115410 0x7fdce4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdceb6196c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce4062900 0x7fdce4062da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdceb6196c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdce4063530 con 0x7fdce4062900 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdceb6196c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40636a0 con 0x7fdce410f200 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdceb6196c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40ff330 con 0x7fdce4115410 2026-02-19T21:04:42.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce938a6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdce410f200 0x7fdce40666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce938a6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdce410f200 0x7fdce40666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:40734/0 (socket says 10.20.193.90:40734) 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce938a6c0 1 -- 10.20.193.90:0/2155452975 learned_addr learned my addr 10.20.193.90:0/2155452975 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce9b8b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce4062900 0x7fdce4062da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce8b896c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdce4115410 0x7fdce4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce8b896c0 1 -- 10.20.193.90:0/2155452975 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdce410f200 msgr2=0x7fdce40666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce8b896c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdce410f200 0x7fdce40666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce8b896c0 1 -- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce4062900 msgr2=0x7fdce4062da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce8b896c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdce4062900 0x7fdce4062da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.797+0000 7fdce8b896c0 1 -- 10.20.193.90:0/2155452975 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd8009590 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdce8b896c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdce4115410 0x7fdce4175cb0 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdce40557d0 tx=0x7fdcd802f9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcd80028d0 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdcd80071c0 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcd80332f0 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce40ff5b0 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce40ff9e0 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdce4052a30 con 0x7fdce4115410 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.798+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 --> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7df0176fc0 con 0x7f7dcc0dd230 2026-02-19T21:04:42.840 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7de5ffb6c0 1 -- 10.20.193.90:0/3676793220 <== osd.1 v2:10.20.193.105:6800/515149626 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7df0176fc0 con 0x7f7dcc0dd230 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] conn(0x7f7dcc0dd230 msgr2=0x7f7dcc0fd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:6800/515149626,v1:10.20.193.105:6801/515149626] conn(0x7f7dcc0dd230 0x7f7dcc0fd6c0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7dcc0b5760 msgr2=0x7f7dcc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7dcc0b5760 0x7f7dcc0d5c10 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7de00024b0 tx=0x7f7de000a240 comp rx=0 tx=0).stop 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df0112020 msgr2=0x7f7df011a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 --2- 10.20.193.90:0/3676793220 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7df0112020 0x7f7df011a3c0 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7dd8005fd0 tx=0x7f7dd800bca0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df57566c0 1 -- 10.20.193.90:0/3676793220 reap_dead start 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 shutdown_connections 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 >> 10.20.193.90:0/3676793220 conn(0x7f7df00e96d0 msgr2=0x7f7df0109ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 shutdown_connections 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.799+0000 7f7df71e06c0 1 -- 10.20.193.90:0/3676793220 wait complete. 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.800+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fdcd80078a0 con 0x7fdce4115410 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdcd27fc6c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcc00b5760 0x7fdcc00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdcd8107ac0 con 0x7fdce4115410 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdce938a6c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcc00b5760 0x7fdcc00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdcd27fc6c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] conn(0x7fdcc00dd220 0x7fdcc00fd6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 --> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcc00fdd80 con 0x7fdcc00dd220 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fdcd8107e70 con 0x7fdce4115410 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.801+0000 7fdce9b8b6c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] conn(0x7fdcc00dd220 0x7fdcc00fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.802+0000 7fdce938a6c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcc00b5760 0x7fdcc00d5c10 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40095e0 tx=0x7fdcd4009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.802+0000 7fdce9b8b6c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] conn(0x7fdcc00dd220 0x7fdcc00fd6b0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.841 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.803+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== osd.8 v2:10.20.193.175:6816/711294156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fdcc00fdd80 con 0x7fdcc00dd220 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- 10.20.193.90:0/2871273756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac6410fbf0 msgr2=0x7fac64114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2871273756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac6410fbf0 0x7fac64114c30 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=12780550757784422621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac4c0098d0 tx=0x7fac4c02ec40 comp rx=0 tx=0).stop 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- 10.20.193.90:0/2871273756 shutdown_connections 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2871273756 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fac64115410 0x7fac64175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2871273756 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac6410fbf0 0x7fac64114c30 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=12780550757784422621 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2871273756 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac6410f200 0x7fac6410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- 10.20.193.90:0/2871273756 >> 10.20.193.90:0/2871273756 conn(0x7fac640ecac0 msgr2=0x7fac6410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- 10.20.193.90:0/2871273756 shutdown_connections 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- 10.20.193.90:0/2871273756 wait complete. 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 Processor -- start 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- start start 2026-02-19T21:04:42.842 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fac6410f200 0x7fac6411b440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac64115410 0x7fac6411b980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac64120d40 0x7fac641211e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac64121750 con 0x7fac64115410 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac641218c0 con 0x7fac6410f200 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.809+0000 7fac692c36c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac64121a80 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac627fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac64115410 0x7fac6411b980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac62ffd6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fac6410f200 0x7fac6411b440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac62ffd6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fac6410f200 0x7fac6411b440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:40754/0 (socket says 10.20.193.90:40754) 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac62ffd6c0 1 -- 10.20.193.90:0/2530687902 learned_addr learned my addr 10.20.193.90:0/2530687902 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac64120d40 0x7fac641211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 -- 10.20.193.90:0/2530687902 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fac6410f200 msgr2=0x7fac6411b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fac6410f200 0x7fac6411b440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 -- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac64115410 msgr2=0x7fac6411b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac64115410 0x7fac6411b980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 -- 10.20.193.90:0/2530687902 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac58009590 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac637fe6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac64120d40 0x7fac641211e0 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5400c6c0 tx=0x7fac5400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac627fc6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fac64115410 0x7fac6411b980 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac54005340 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fac54003cd0 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac4c0094c0 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac5400dbf0 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.810+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac64162280 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.811+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac64052a30 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.812+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fac54003810 con 0x7fac64120d40 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.813+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 --> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdce4179210 con 0x7fdcc00dd220 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.813+0000 7fdcd27fc6c0 1 -- 10.20.193.90:0/2155452975 <== osd.8 v2:10.20.193.175:6816/711294156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdce4179210 con 0x7fdcc00dd220 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac43fff6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fac380b57e0 0x7fac380d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.843 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fac540e4c80 con 0x7fac64120d40 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] conn(0x7fdcc00dd220 msgr2=0x7fdcc00fd6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:6816/711294156,v1:10.20.193.175:6817/711294156] conn(0x7fdcc00dd220 0x7fdcc00fd6b0 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac43fff6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] conn(0x7fac380dd2b0 0x7fac380fd740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcc00b5760 msgr2=0x7fdcc00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcc00b5760 0x7fdcc00d5c10 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd40095e0 tx=0x7fdcd4009260 comp rx=0 tx=0).stop 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac62ffd6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fac380b57e0 0x7fac380d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 --> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac380fde10 con 0x7fac380dd2b0 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fac540e4fb0 con 0x7fac64120d40 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdce4115410 msgr2=0x7fdce4175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 --2- 10.20.193.90:0/2155452975 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdce4115410 0x7fdce4175cb0 secure :-1 s=READY pgs=68 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdce40557d0 tx=0x7fdcd802f9c0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdce9b8b6c0 1 -- 10.20.193.90:0/2155452975 reap_dead start 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac627fc6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] conn(0x7fac380dd2b0 0x7fac380fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 shutdown_connections 2026-02-19T21:04:42.844 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 >> 10.20.193.90:0/2155452975 conn(0x7fdce40ecac0 msgr2=0x7fdce410d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fac62ffd6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fac380b57e0 0x7fac380d5c90 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac58005b40 tx=0x7fac58009310 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 shutdown_connections 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.814+0000 7fdceb6196c0 1 -- 10.20.193.90:0/2155452975 wait complete. 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.815+0000 7fac627fc6c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] conn(0x7fac380dd2b0 0x7fac380fd740 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.815+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== osd.9 v2:10.20.193.90:6826/72013082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fac380fde10 con 0x7fac380dd2b0 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.827+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 --> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac64063d20 con 0x7fac380dd2b0 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.827+0000 7fac43fff6c0 1 -- 10.20.193.90:0/2530687902 <== osd.9 v2:10.20.193.90:6826/72013082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fac64063d20 con 0x7fac380dd2b0 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] conn(0x7fac380dd2b0 msgr2=0x7fac380fd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6826/72013082,v1:10.20.193.90:6827/72013082] conn(0x7fac380dd2b0 0x7fac380fd740 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fac380b57e0 msgr2=0x7fac380d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fac380b57e0 0x7fac380d5c90 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac58005b40 tx=0x7fac58009310 comp rx=0 tx=0).stop 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac64120d40 msgr2=0x7fac641211e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:42.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 --2- 10.20.193.90:0/2530687902 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fac64120d40 0x7fac641211e0 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac5400c6c0 tx=0x7fac5400cb90 comp rx=0 tx=0).stop 2026-02-19T21:04:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac637fe6c0 1 -- 10.20.193.90:0/2530687902 reap_dead start 2026-02-19T21:04:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 shutdown_connections 2026-02-19T21:04:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 >> 10.20.193.90:0/2530687902 conn(0x7fac640ecac0 msgr2=0x7fac6410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 shutdown_connections 2026-02-19T21:04:42.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:42.828+0000 7fac692c36c0 1 -- 10.20.193.90:0/2530687902 wait complete. 2026-02-19T21:04:42.846 INFO:teuthology.orchestra.run.trial090.stdout:34359738391 2026-02-19T21:04:42.846 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-19T21:04:42.852 INFO:teuthology.orchestra.run.trial090.stdout:128849018897 2026-02-19T21:04:42.852 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-19T21:04:42.859 INFO:teuthology.orchestra.run.trial090.stdout:98784247828 2026-02-19T21:04:42.859 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-19T21:04:42.860 INFO:teuthology.orchestra.run.trial090.stdout:300647710727 2026-02-19T21:04:42.860 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-19T21:04:42.863 INFO:teuthology.orchestra.run.trial090.stdout:51539607574 2026-02-19T21:04:42.864 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-19T21:04:42.896 INFO:teuthology.orchestra.run.trial090.stdout:253403070475 2026-02-19T21:04:42.896 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-19T21:04:42.899 INFO:teuthology.orchestra.run.trial090.stdout:68719476757 2026-02-19T21:04:42.899 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-19T21:04:42.901 INFO:teuthology.orchestra.run.trial090.stdout:223338299404 2026-02-19T21:04:42.902 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-19T21:04:42.905 INFO:teuthology.orchestra.run.trial090.stdout:146028888080 2026-02-19T21:04:42.906 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-19T21:04:42.916 INFO:teuthology.orchestra.run.trial090.stdout:176093659151 2026-02-19T21:04:42.916 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-19T21:04:42.922 INFO:teuthology.orchestra.run.trial090.stdout:270582939656 2026-02-19T21:04:42.922 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2026-02-19T21:04:42.925 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2026-02-19T21:04:42.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: osdmap e76: 12 total, 12 up, 12 in 2026-02-19T21:04:42.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2227958270' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:42.926 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:42 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/77448472' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:42.935 INFO:teuthology.orchestra.run.trial090.stdout:193273528333 2026-02-19T21:04:42.935 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-19T21:04:42.998 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.006 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.007 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.007 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.042 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.045 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.048 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.063 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.069 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.070 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.076 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.134 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 -- 10.20.193.90:0/825249832 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 msgr2=0x7f32e4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 --2- 10.20.193.90:0/825249832 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e4175db0 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=8876517670084680355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32e000aa70 tx=0x7f32e002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 -- 10.20.193.90:0/825249832 shutdown_connections 2026-02-19T21:04:43.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 --2- 10.20.193.90:0/825249832 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e4175db0 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=8876517670084680355 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.138 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 --2- 10.20.193.90:0/825249832 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f32e410fbf0 0x7f32e4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.138 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 --2- 10.20.193.90:0/825249832 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f32e410f200 0x7f32e410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.138 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 -- 10.20.193.90:0/825249832 >> 10.20.193.90:0/825249832 conn(0x7f32e40ecac0 msgr2=0x7f32e410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.138 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 -- 10.20.193.90:0/825249832 shutdown_connections 2026-02-19T21:04:43.138 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.135+0000 7f32eae456c0 1 -- 10.20.193.90:0/825249832 wait complete. 2026-02-19T21:04:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 Processor -- start 2026-02-19T21:04:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 -- start start 2026-02-19T21:04:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f32e410f200 0x7f32e411bbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.140 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e411c130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f32e41214f0 0x7f32e4121990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32e4121f00 con 0x7f32e4115410 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32e4122070 con 0x7f32e41214f0 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32eae456c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f32e4122230 con 0x7f32e410f200 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e411c130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e411c130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43822/0 (socket says 10.20.193.90:43822) 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 -- 10.20.193.90:0/953808560 learned_addr learned my addr 10.20.193.90:0/953808560 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32e8bb66c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f32e410f200 0x7f32e411bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32e93b76c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f32e41214f0 0x7f32e4121990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 -- 10.20.193.90:0/953808560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f32e410f200 msgr2=0x7f32e411bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f32e410f200 0x7f32e411bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 -- 10.20.193.90:0/953808560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f32e41214f0 msgr2=0x7f32e4121990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f32e41214f0 0x7f32e4121990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.136+0000 7f32dbfff6c0 1 -- 10.20.193.90:0/953808560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e000a660 con 0x7f32e4115410 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.137+0000 7f32dbfff6c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e411c130 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32cc00b6c0 tx=0x7f32cc00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.137+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32cc004250 con 0x7f32e4115410 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.137+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f32cc009070 con 0x7f32e4115410 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.137+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32cc00ccb0 con 0x7f32e4115410 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.137+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e41626e0 con 0x7f32e4115410 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.137+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e4162b70 con 0x7f32e4115410 2026-02-19T21:04:43.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.138+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e41104d0 con 0x7f32e4115410 2026-02-19T21:04:43.143 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.139+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f32cc0028c0 con 0x7f32e4115410 2026-02-19T21:04:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.140+0000 7f32d9ffb6c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f32c00b5760 0x7f32c00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.140+0000 7f32e8bb66c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f32c00b5760 0x7f32c00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.140+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f32cc0e3d60 con 0x7f32e4115410 2026-02-19T21:04:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.140+0000 7f32e8bb66c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f32c00b5760 0x7f32c00d5c10 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d4005980 tx=0x7f32d4005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.141+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f32cc0a65f0 con 0x7f32e4115410 2026-02-19T21:04:43.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.142+0000 7fbce37fe6c0 1 -- 10.20.193.90:0/1836788727 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbcdc0044a0 con 0x7fbcec10f1e0 2026-02-19T21:04:43.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/1836788727 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 msgr2=0x7fbcec10f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/1836788727 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec10f5b0 secure :-1 s=READY pgs=268 gs=3 cs=0 l=1 c_cookie=9378070854829508052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcdc0098d0 tx=0x7fbcdc02ec40 comp rx=0 tx=0).stop 2026-02-19T21:04:43.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3820156403 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb5010f200 msgr2=0x7feb5010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3820156403 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb5010f200 0x7feb5010f5d0 secure :-1 s=READY pgs=71 gs=2 cs=0 l=1 c_cookie=15417930009814939271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb44009970 tx=0x7feb4402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3820156403 shutdown_connections 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3820156403 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb50115410 0x7feb50175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3820156403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb5010fbf0 0x7feb50114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3820156403 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb5010f200 0x7feb5010f5d0 unknown :-1 s=CLOSED pgs=71 gs=2 cs=0 l=1 c_cookie=15417930009814939271 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3820156403 >> 10.20.193.90:0/3820156403 conn(0x7feb500ecac0 msgr2=0x7feb5010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3820156403 shutdown_connections 2026-02-19T21:04:43.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3820156403 wait complete. 2026-02-19T21:04:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/1836788727 shutdown_connections 2026-02-19T21:04:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/1836788727 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec1153f0 0x7fbcec175d90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/1836788727 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec10fbd0 0x7fbcec114c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/1836788727 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec10f5b0 unknown :-1 s=CLOSED pgs=268 gs=3 cs=0 l=1 c_cookie=9378070854829508052 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/1836788727 >> 10.20.193.90:0/1836788727 conn(0x7fbcec0ecac0 msgr2=0x7fbcec10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/1836788727 shutdown_connections 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/1836788727 wait complete. 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 Processor -- start 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7fbcf326b6c0 1 -- start start 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec05d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec1153f0 0x7fbcec175c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec05db00 0x7fbcec1002c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec05e1c0 con 0x7fbcec10f1e0 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec100800 con 0x7fbcec1153f0 2026-02-19T21:04:43.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec1009c0 con 0x7fbcec05db00 2026-02-19T21:04:43.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf0fdc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec05d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf0fdc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec05d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43848/0 (socket says 10.20.193.90:43848) 2026-02-19T21:04:43.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 Processor -- start 2026-02-19T21:04:43.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/4253254281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 msgr2=0x7f433c113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/4253254281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c113b30 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=12276681405753398210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4330009970 tx=0x7f433002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/4253254281 shutdown_connections 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/4253254281 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f433c1198b0 0x7f433c17a280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/4253254281 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f433c114150 0x7f433c119100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/4253254281 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c113b30 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=12276681405753398210 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/4253254281 >> 10.20.193.90:0/4253254281 conn(0x7f433c060720 msgr2=0x7f433c060cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf0fdc6c0 1 -- 10.20.193.90:0/3440749766 learned_addr learned my addr 10.20.193.90:0/3440749766 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec05db00 0x7fbcec1002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbce3fff6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec1153f0 0x7fbcec175c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.143+0000 7feb5509f6c0 1 -- start start 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb5010f200 0x7feb500666f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb50115410 0x7feb50062950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 0x7feb500633d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb50167c30 con 0x7feb50115410 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb5011d010 con 0x7feb50062f30 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb5011d1d0 con 0x7feb5010f200 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4ed766c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb5010f200 0x7feb500666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4f5776c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 0x7feb500633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb50115410 0x7feb50062950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4ed766c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb5010f200 0x7feb500666f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:38116/0 (socket says 10.20.193.90:38116) 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4ed766c0 1 -- 10.20.193.90:0/3510167347 learned_addr learned my addr 10.20.193.90:0/3510167347 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4f5776c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 0x7feb500633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:40836/0 (socket says 10.20.193.90:40836) 2026-02-19T21:04:43.153 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/4253254281 shutdown_connections 2026-02-19T21:04:43.153 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/4253254281 wait complete. 2026-02-19T21:04:43.153 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 -- 10.20.193.90:0/3510167347 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb5010f200 msgr2=0x7feb500666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb5010f200 0x7feb500666f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 -- 10.20.193.90:0/3510167347 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 msgr2=0x7feb500633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 0x7feb500633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 -- 10.20.193.90:0/3510167347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb380094c0 con 0x7feb50115410 2026-02-19T21:04:43.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4f5776c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 0x7feb500633d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:43.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 -- 10.20.193.90:0/3440749766 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec1153f0 msgr2=0x7fbcec175c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec1153f0 0x7fbcec175c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 -- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 msgr2=0x7fbcec05d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb4e5756c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb50115410 0x7feb50062950 secure :-1 s=READY pgs=270 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb38004750 tx=0x7feb3800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2026-02-19T21:04:43.156 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2026-02-19T21:04:43.157 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: osdmap e76: 12 total, 12 up, 12 in 2026-02-19T21:04:43.157 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2227958270' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:43.157 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:42 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/77448472' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:43.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec05d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 -- 10.20.193.90:0/3440749766 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd4009590 con 0x7fbcec05db00 2026-02-19T21:04:43.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbce3fff6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec1153f0 0x7fbcec175c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:43.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf17dd6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec05db00 0x7fbcec1002c0 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce8006fd0 tx=0x7fbce800cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb380044a0 con 0x7feb50115410 2026-02-19T21:04:43.159 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7feb38009030 con 0x7feb50115410 2026-02-19T21:04:43.159 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb44009590 con 0x7feb50115410 2026-02-19T21:04:43.159 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb3800ce50 con 0x7feb50115410 2026-02-19T21:04:43.159 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5011d850 con 0x7feb50115410 2026-02-19T21:04:43.159 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7f4340b7b6c0 1 Processor -- start 2026-02-19T21:04:43.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbce8003c40 con 0x7fbcec05db00 2026-02-19T21:04:43.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.144+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc0094c0 con 0x7fbcec05db00 2026-02-19T21:04:43.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 -- start start 2026-02-19T21:04:43.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c1217c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbce800a070 con 0x7fbcec05db00 2026-02-19T21:04:43.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbce800dd10 con 0x7fbcec05db00 2026-02-19T21:04:43.161 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec101040 con 0x7fbcec05db00 2026-02-19T21:04:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f433c1198b0 0x7f433c121d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f433c1270c0 0x7f433c127560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f433c127aa0 con 0x7f433c113760 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f433c127c10 con 0x7f433c1270c0 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f4340b7b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f433c127dd0 con 0x7f433c1198b0 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c1217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c1217c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43858/0 (socket says 10.20.193.90:43858) 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 -- 10.20.193.90:0/2850928029 learned_addr learned my addr 10.20.193.90:0/2850928029 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433ad766c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f433c1270c0 0x7f433c127560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 -- 10.20.193.90:0/2850928029 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f433c1198b0 msgr2=0x7f433c121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f433c1198b0 0x7f433c121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 -- 10.20.193.90:0/2850928029 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f433c1270c0 msgr2=0x7f433c127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f433c1270c0 0x7f433c127560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec1104b0 con 0x7fbcec05db00 2026-02-19T21:04:43.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 -- 10.20.193.90:0/2850928029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4330009590 con 0x7f433c113760 2026-02-19T21:04:43.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f433a5756c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c1217c0 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43300092b0 tx=0x7f433002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.146+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb501104d0 con 0x7feb50115410 2026-02-19T21:04:43.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.145+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4330002ba0 con 0x7f433c113760 2026-02-19T21:04:43.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.146+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4330002d00 con 0x7f433c113760 2026-02-19T21:04:43.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.146+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f43300372f0 con 0x7f433c113760 2026-02-19T21:04:43.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.146+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433c168250 con 0x7f433c113760 2026-02-19T21:04:43.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.146+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f433c168680 con 0x7f433c113760 2026-02-19T21:04:43.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.146+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f433c1149a0 con 0x7f433c113760 2026-02-19T21:04:43.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.147+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7feb380026b0 con 0x7feb50115410 2026-02-19T21:04:43.167 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.147+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fbce8005030 con 0x7fbcec05db00 2026-02-19T21:04:43.167 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.147+0000 7fbce1ffb6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbcc80b57e0 0x7fbcc80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.167 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.147+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fbce80e4b30 con 0x7fbcec05db00 2026-02-19T21:04:43.167 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.147+0000 7fbcf0fdc6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbcc80b57e0 0x7fbcc80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7feb2ffff6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feb240b5760 0x7feb240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7fbcf0fdc6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbcc80b57e0 0x7fbcc80d5c90 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcdc0097f0 tx=0x7fbcdc005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7feb4ed766c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feb240b5760 0x7feb240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f43300071c0 con 0x7f433c113760 2026-02-19T21:04:43.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7feb380e3c50 con 0x7feb50115410 2026-02-19T21:04:43.169 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbce80a7380 con 0x7fbcec05db00 2026-02-19T21:04:43.170 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.148+0000 7feb4ed766c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feb240b5760 0x7feb240d5c10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb440023e0 tx=0x7feb44005ae0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.149+0000 7f43237fe6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43140b57e0 0x7f43140d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.149+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f4330107ee0 con 0x7f433c113760 2026-02-19T21:04:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.149+0000 7f4339d746c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43140b57e0 0x7f43140d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.171 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.149+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feb380a6570 con 0x7feb50115410 2026-02-19T21:04:43.172 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.149+0000 7f4339d746c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43140b57e0 0x7f43140d5c90 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4324005980 tx=0x7f4324005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.172 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.152+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f43300ca7c0 con 0x7f433c113760 2026-02-19T21:04:43.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1690372341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8061070 msgr2=0x7ff7e81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1690372341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8061070 0x7ff7e81550e0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=5039845102395813445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7dc009970 tx=0x7ff7dc02ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1690372341 shutdown_connections 2026-02-19T21:04:43.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1690372341 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff7e8155620 0x7ff7e8175a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1690372341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8061070 0x7ff7e81550e0 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=5039845102395813445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1690372341 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff7e8060760 0x7ff7e8060b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1690372341 >> 10.20.193.90:0/1690372341 conn(0x7ff7e80ea870 msgr2=0x7ff7e810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1690372341 shutdown_connections 2026-02-19T21:04:43.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.185+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1690372341 wait complete. 2026-02-19T21:04:43.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 Processor -- start 2026-02-19T21:04:43.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 -- start start 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 0x7ff7e81614b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff7e8061070 0x7ff7e81619f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff7e8155620 0x7ff7e8166db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8167400 con 0x7ff7e8060760 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8167570 con 0x7ff7e8061070 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7efcff6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e8167730 con 0x7ff7e8155620 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 0x7ff7e81614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 0x7ff7e81614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43878/0 (socket says 10.20.193.90:43878) 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 -- 10.20.193.90:0/1252284923 learned_addr learned my addr 10.20.193.90:0/1252284923 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7ee2716c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff7e8155620 0x7ff7e8166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7ed26f6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff7e8061070 0x7ff7e81619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 -- 10.20.193.90:0/1252284923 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff7e8155620 msgr2=0x7ff7e8166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff7e8155620 0x7ff7e8166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 -- 10.20.193.90:0/1252284923 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff7e8061070 msgr2=0x7ff7e81619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff7e8061070 0x7ff7e81619f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.186+0000 7ff7eda706c0 1 -- 10.20.193.90:0/1252284923 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc009590 con 0x7ff7e8060760 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.187+0000 7ff7eda706c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 0x7ff7e81614b0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d800b710 tx=0x7ff7d800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.187+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d8004250 con 0x7ff7e8060760 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.187+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff7d8009070 con 0x7ff7e8060760 2026-02-19T21:04:43.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.187+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e8167a10 con 0x7ff7e8060760 2026-02-19T21:04:43.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.187+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e8151250 con 0x7ff7e8060760 2026-02-19T21:04:43.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.187+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff7d800ccd0 con 0x7ff7e8060760 2026-02-19T21:04:43.193 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.188+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e8061c70 con 0x7ff7e8060760 2026-02-19T21:04:43.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.189+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7ff7d80028c0 con 0x7ff7e8060760 2026-02-19T21:04:43.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.190+0000 7ff7d6ffd6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7c40b5760 0x7ff7c40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.190+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ff7d80e3d40 con 0x7ff7e8060760 2026-02-19T21:04:43.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.190+0000 7ff7ed26f6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7c40b5760 0x7ff7c40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.190+0000 7ff7ed26f6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7c40b5760 0x7ff7c40d5c10 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7dc0098c0 tx=0x7ff7dc0091a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.194 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.192+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff7d80a65d0 con 0x7ff7e8060760 2026-02-19T21:04:43.199 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/774544607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb40601c0 msgr2=0x7fbeb41127d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.199 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/774544607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb40601c0 0x7fbeb41127d0 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=1968505257415315158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea80099a0 tx=0x7fbea802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.199 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/774544607 shutdown_connections 2026-02-19T21:04:43.199 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/774544607 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbeb4112fb0 0x7fbeb4173950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/774544607 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb40601c0 0x7fbeb41127d0 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=1968505257415315158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/774544607 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbeb405f7d0 0x7fbeb405fba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/774544607 >> 10.20.193.90:0/774544607 conn(0x7fbeb40e9520 msgr2=0x7fbeb4109930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/774544607 shutdown_connections 2026-02-19T21:04:43.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/774544607 wait complete. 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 -- 10.20.193.90:0/4288448155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff39010ba70 msgr2=0x7ff39010be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 --2- 10.20.193.90:0/4288448155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff39010ba70 0x7ff39010be40 secure :-1 s=READY pgs=275 gs=3 cs=0 l=1 c_cookie=16521539288841088491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff380009970 tx=0x7ff38002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 -- 10.20.193.90:0/4288448155 shutdown_connections 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 --2- 10.20.193.90:0/4288448155 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff390111080 0x7ff390111500 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 --2- 10.20.193.90:0/4288448155 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff39010c460 0x7ff390110a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 --2- 10.20.193.90:0/4288448155 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff39010ba70 0x7ff39010be40 unknown :-1 s=CLOSED pgs=275 gs=3 cs=0 l=1 c_cookie=16521539288841088491 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 -- 10.20.193.90:0/4288448155 >> 10.20.193.90:0/4288448155 conn(0x7ff3900e96c0 msgr2=0x7ff390109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 -- 10.20.193.90:0/4288448155 shutdown_connections 2026-02-19T21:04:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7fbebaa4b6c0 1 Processor -- start 2026-02-19T21:04:43.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.197+0000 7ff397f116c0 1 -- 10.20.193.90:0/4288448155 wait complete. 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 -- start start 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 0x7fbeb40ed760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbeb4112fb0 0x7fbeb4173850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbeb40e99c0 0x7fbeb40e9e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40ea5f0 con 0x7fbeb405f7d0 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40ea730 con 0x7fbeb40e99c0 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40f3640 con 0x7fbeb4112fb0 2026-02-19T21:04:43.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 0x7fbeb40ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 0x7fbeb40ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43942/0 (socket says 10.20.193.90:43942) 2026-02-19T21:04:43.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 -- 10.20.193.90:0/3850499290 learned_addr learned my addr 10.20.193.90:0/3850499290 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb92486c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbeb4112fb0 0x7fbeb4173850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeba24a6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbeb40e99c0 0x7fbeb40e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 -- 10.20.193.90:0/1129889328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa77810f200 msgr2=0x7fa77810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/1129889328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa77810f200 0x7fa77810f5d0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=5098010102776370898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7680099a0 tx=0x7fa76802ed00 comp rx=0 tx=0).stop 2026-02-19T21:04:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 -- 10.20.193.90:0/3850499290 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbeb4112fb0 msgr2=0x7fbeb4173850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbeb4112fb0 0x7fbeb4173850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 -- 10.20.193.90:0/3850499290 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbeb40e99c0 msgr2=0x7fbeb40e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbeb40e99c0 0x7fbeb40e9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 -- 10.20.193.90:0/3850499290 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea8009590 con 0x7fbeb405f7d0 2026-02-19T21:04:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 -- 10.20.193.90:0/1129889328 shutdown_connections 2026-02-19T21:04:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/1129889328 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa778115410 0x7fa778175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/1129889328 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa77810fbf0 0x7fa778114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/1129889328 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa77810f200 0x7fa77810f5d0 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=5098010102776370898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 -- 10.20.193.90:0/1129889328 >> 10.20.193.90:0/1129889328 conn(0x7fa7780ecac0 msgr2=0x7fa77810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 -- 10.20.193.90:0/1129889328 shutdown_connections 2026-02-19T21:04:43.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 Processor -- start 2026-02-19T21:04:43.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 -- start start 2026-02-19T21:04:43.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbeb9a496c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 0x7fbeb40ed760 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea4005dc0 tx=0x7fbea400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbea4004250 con 0x7fbeb405f7d0 2026-02-19T21:04:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff39010ba70 0x7ff390121ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 0x7ff390122010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbea4009070 con 0x7fbeb405f7d0 2026-02-19T21:04:43.209 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb40f3920 con 0x7fbeb405f7d0 2026-02-19T21:04:43.209 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fa77ee306c0 1 -- 10.20.193.90:0/1129889328 wait complete. 2026-02-19T21:04:43.209 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff390111080 0x7ff3901273d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.209 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff390127a20 con 0x7ff390111080 2026-02-19T21:04:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff390127b90 con 0x7ff39010ba70 2026-02-19T21:04:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff397f116c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff390127d50 con 0x7ff39010c460 2026-02-19T21:04:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbea400cde0 con 0x7fbeb405f7d0 2026-02-19T21:04:43.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb40f3e00 con 0x7fbeb405f7d0 2026-02-19T21:04:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff3954816c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 0x7ff390122010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff3954816c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 0x7ff390122010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:38192/0 (socket says 10.20.193.90:38192) 2026-02-19T21:04:43.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.198+0000 7ff3954816c0 1 -- 10.20.193.90:0/3866304372 learned_addr learned my addr 10.20.193.90:0/3866304372 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3964836c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff390111080 0x7ff3901273d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff395c826c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff39010ba70 0x7ff390121ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3954816c0 1 -- 10.20.193.90:0/3866304372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff39010ba70 msgr2=0x7ff390121ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3954816c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff39010ba70 0x7ff390121ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3954816c0 1 -- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff390111080 msgr2=0x7ff3901273d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3954816c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff390111080 0x7ff3901273d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3954816c0 1 -- 10.20.193.90:0/3866304372 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff380009590 con 0x7ff39010c460 2026-02-19T21:04:43.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 Processor -- start 2026-02-19T21:04:43.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 -- start start 2026-02-19T21:04:43.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff3954816c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 0x7ff390122010 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff384009490 tx=0x7ff38400bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb410e070 con 0x7fbeb405f7d0 2026-02-19T21:04:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 0x7fa77811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa778115410 0x7fa77811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff384004a80 con 0x7ff39010c460 2026-02-19T21:04:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff390128030 con 0x7ff39010c460 2026-02-19T21:04:43.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa778122c30 0x7fa7781230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff384009030 con 0x7ff39010c460 2026-02-19T21:04:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff390168710 con 0x7ff39010c460 2026-02-19T21:04:43.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff38400cd70 con 0x7ff39010c460 2026-02-19T21:04:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa778123640 con 0x7fa778122c30 2026-02-19T21:04:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7781237b0 con 0x7fa778115410 2026-02-19T21:04:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77ee306c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa778123970 con 0x7fa77810f200 2026-02-19T21:04:43.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77cba56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 0x7fa77811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77cba56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 0x7fa77811d330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:38204/0 (socket says 10.20.193.90:38204) 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa77cba56c0 1 -- 10.20.193.90:0/2613399413 learned_addr learned my addr 10.20.193.90:0/2613399413 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.199+0000 7fa76ffff6c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa778115410 0x7fa77811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77cba56c0 1 -- 10.20.193.90:0/2613399413 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa778115410 msgr2=0x7fa77811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77cba56c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa778115410 0x7fa77811d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77cba56c0 1 -- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa778122c30 msgr2=0x7fa7781230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77cba56c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa778122c30 0x7fa7781230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77cba56c0 1 -- 10.20.193.90:0/2613399413 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa768009590 con 0x7fa77810f200 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77cba56c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 0x7fa77811d330 secure :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa768031fd0 tx=0x7fa76802fbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa768002ae0 con 0x7fa77810f200 2026-02-19T21:04:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa768002c40 con 0x7fa77810f200 2026-02-19T21:04:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7680372f0 con 0x7fa77810f200 2026-02-19T21:04:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39005fb50 con 0x7ff39010c460 2026-02-19T21:04:43.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa778163dc0 con 0x7fa77810f200 2026-02-19T21:04:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.200+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa778164240 con 0x7fa77810f200 2026-02-19T21:04:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.201+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fbea40028c0 con 0x7fbeb405f7d0 2026-02-19T21:04:43.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.201+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7ff384005020 con 0x7ff39010c460 2026-02-19T21:04:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.201+0000 7fbea2ffd6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbe900b5760 0x7fbe900d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7781104d0 con 0x7fa77810f200 2026-02-19T21:04:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fbeb92486c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbe900b5760 0x7fbe900d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7ff37effd6c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff36c0b5760 0x7ff36c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fbea40e3cd0 con 0x7fbeb405f7d0 2026-02-19T21:04:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fbeb92486c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbe900b5760 0x7fbe900d5c10 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea8005b40 tx=0x7fbea8005c40 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ff3840e3cc0 con 0x7ff39010c460 2026-02-19T21:04:43.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fa7680077f0 con 0x7fa77810f200 2026-02-19T21:04:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbea40a9f80 con 0x7fbeb405f7d0 2026-02-19T21:04:43.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7ff395c826c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff36c0b5760 0x7ff36c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3673120507 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e410d960 msgr2=0x7fb5e41129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3673120507 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e410d960 0x7fb5e41129a0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=10890700150468088559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d80099a0 tx=0x7fb5d802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3673120507 shutdown_connections 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3673120507 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5e4113180 0x7fb5e4173b20 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3673120507 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e410d960 0x7fb5e41129a0 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=10890700150468088559 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3673120507 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5e410cf70 0x7fb5e410d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3673120507 >> 10.20.193.90:0/3673120507 conn(0x7fb5e40ea870 msgr2=0x7fb5e410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3673120507 shutdown_connections 2026-02-19T21:04:43.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.202+0000 7ff395c826c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff36c0b5760 0x7ff36c0d5c10 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3800023e0 tx=0x7ff380031f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3673120507 wait complete. 2026-02-19T21:04:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fa76dffb6c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7540b57e0 0x7fa7540d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fa76ffff6c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7540b57e0 0x7fa7540d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fa768107fc0 con 0x7fa77810f200 2026-02-19T21:04:43.226 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 Processor -- start 2026-02-19T21:04:43.226 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fa76ffff6c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7540b57e0 0x7fa7540d5c90 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa760005dc0 tx=0x7fa760005d10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 -- start start 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5e410cf70 0x7fb5e40f9330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5e4113180 0x7fb5e4173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 0x7fb5e40feac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40fa050 con 0x7fb5e40f9960 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40ff000 con 0x7fb5e410cf70 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5eb7dc6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40ff1c0 con 0x7fb5e4113180 2026-02-19T21:04:43.227 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff3840a6550 con 0x7ff39010c460 2026-02-19T21:04:43.228 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5e8d506c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5e4113180 0x7fb5e4173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.228 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5e95516c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5e410cf70 0x7fb5e40f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.228 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5e9d526c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 0x7fb5e40feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5e9d526c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 0x7fb5e40feac0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43978/0 (socket says 10.20.193.90:43978) 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.203+0000 7fb5e9d526c0 1 -- 10.20.193.90:0/3429242720 learned_addr learned my addr 10.20.193.90:0/3429242720 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5e9d526c0 1 -- 10.20.193.90:0/3429242720 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5e4113180 msgr2=0x7fb5e4173a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5e9d526c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5e4113180 0x7fb5e4173a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5e9d526c0 1 -- 10.20.193.90:0/3429242720 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5e410cf70 msgr2=0x7fb5e40f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5e9d526c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5e410cf70 0x7fb5e40f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5e9d526c0 1 -- 10.20.193.90:0/3429242720 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d8009590 con 0x7fb5e40f9960 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5e9d526c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 0x7fb5e40feac0 secure :-1 s=READY pgs=279 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e000c6c0 tx=0x7fb5e000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5e0003ce0 con 0x7fb5e40f9960 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb5e000ce70 con 0x7fb5e40f9960 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5e000dda0 con 0x7fb5e40f9960 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e40ff4a0 con 0x7fb5e40f9960 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.204+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e40ff930 con 0x7fb5e40f9960 2026-02-19T21:04:43.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.205+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e410e240 con 0x7fb5e40f9960 2026-02-19T21:04:43.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.205+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa7680ca810 con 0x7fa77810f200 2026-02-19T21:04:43.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.207+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fb5e0005030 con 0x7fb5e40f9960 2026-02-19T21:04:43.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7fb5d27fc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb5c00b5760 0x7fb5c00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7fb5e95516c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb5c00b5760 0x7fb5c00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fb5e00e47b0 con 0x7fb5e40f9960 2026-02-19T21:04:43.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5e00e4c30 con 0x7fb5e40f9960 2026-02-19T21:04:43.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7fb5e95516c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb5c00b5760 0x7fb5c00d5c10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d4004750 tx=0x7fb5d4009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 -- 10.20.193.90:0/1700325679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010fbf0 msgr2=0x7f2d10114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/1700325679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010fbf0 0x7f2d10114c30 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=17447029923853465093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cfc0099a0 tx=0x7f2cfc02ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 -- 10.20.193.90:0/1700325679 shutdown_connections 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/1700325679 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d10115410 0x7f2d10175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/1700325679 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010fbf0 0x7f2d10114c30 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=17447029923853465093 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/1700325679 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d1010f200 0x7f2d1010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 -- 10.20.193.90:0/1700325679 >> 10.20.193.90:0/1700325679 conn(0x7f2d100ecac0 msgr2=0x7f2d1010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 -- 10.20.193.90:0/1700325679 shutdown_connections 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.208+0000 7f2d14b476c0 1 -- 10.20.193.90:0/1700325679 wait complete. 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 Processor -- start 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 -- start start 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010f200 0x7f2d1011afa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d10115410 0x7f2d1011b4e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d101208a0 0x7f2d10120d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101212b0 con 0x7f2d1010f200 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10121420 con 0x7f2d10115410 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d14b476c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101215e0 con 0x7f2d101208a0 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d0e5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010f200 0x7f2d1011afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d0e5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010f200 0x7f2d1011afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:44010/0 (socket says 10.20.193.90:44010) 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d0e5756c0 1 -- 10.20.193.90:0/4211710263 learned_addr learned my addr 10.20.193.90:0/4211710263 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.209+0000 7f2d0ed766c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d101208a0 0x7f2d10120d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0dd746c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d10115410 0x7f2d1011b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0ed766c0 1 -- 10.20.193.90:0/4211710263 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d10115410 msgr2=0x7f2d1011b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0ed766c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d10115410 0x7f2d1011b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0ed766c0 1 -- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010f200 msgr2=0x7f2d1011afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0ed766c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010f200 0x7f2d1011afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0ed766c0 1 -- 10.20.193.90:0/4211710263 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d000094c0 con 0x7f2d101208a0 2026-02-19T21:04:43.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 -- 10.20.193.90:0/724187290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c8115410 msgr2=0x7fc9c8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/724187290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c8115410 0x7fc9c8175db0 secure :-1 s=READY pgs=281 gs=2 cs=0 l=1 c_cookie=5126904562458217006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9bc00a9b0 tx=0x7fc9bc02fd20 comp rx=0 tx=0).stop 2026-02-19T21:04:43.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 -- 10.20.193.90:0/724187290 shutdown_connections 2026-02-19T21:04:43.234 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d0ed766c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d101208a0 0x7f2d10120d40 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d0000b9b0 tx=0x7f2d0000be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/724187290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c8115410 0x7fc9c8175db0 unknown :-1 s=CLOSED pgs=281 gs=2 cs=0 l=1 c_cookie=5126904562458217006 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/724187290 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c810fbf0 0x7fc9c8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/724187290 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc9c810f200 0x7fc9c810f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 -- 10.20.193.90:0/724187290 >> 10.20.193.90:0/724187290 conn(0x7fc9c80eca60 msgr2=0x7fc9c810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 -- 10.20.193.90:0/724187290 shutdown_connections 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 -- 10.20.193.90:0/724187290 wait complete. 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d00004250 con 0x7f2d101208a0 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2d00009070 con 0x7f2d101208a0 2026-02-19T21:04:43.235 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d0000ce70 con 0x7f2d101208a0 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc009590 con 0x7f2d101208a0 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d10161d90 con 0x7f2d101208a0 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 Processor -- start 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.210+0000 7fc9cde046c0 1 -- start start 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9cde046c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc9c810f200 0x7fc9c80fe240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9cde046c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 0x7fc9c8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.236 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9cde046c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c80fe780 0x7fc9c80fec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9cde046c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c8103350 con 0x7fc9c80fe780 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9cde046c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c81034c0 con 0x7fc9c8115410 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9cde046c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c8103630 con 0x7fc9c810f200 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c6ffd6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 0x7fc9c8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c80fe780 0x7fc9c80fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c6ffd6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 0x7fc9c8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:40994/0 (socket says 10.20.193.90:40994) 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c6ffd6c0 1 -- 10.20.193.90:0/1743695214 learned_addr learned my addr 10.20.193.90:0/1743695214 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c77fe6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc9c810f200 0x7fc9c80fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.237 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d101104d0 con 0x7f2d101208a0 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c7fff6c0 1 -- 10.20.193.90:0/1743695214 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc9c810f200 msgr2=0x7fc9c80fe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c7fff6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc9c810f200 0x7fc9c80fe240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c7fff6c0 1 -- 10.20.193.90:0/1743695214 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 msgr2=0x7fc9c8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c7fff6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 0x7fc9c8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c7fff6c0 1 -- 10.20.193.90:0/1743695214 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc00a5b0 con 0x7fc9c80fe780 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.211+0000 7fc9c6ffd6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 0x7fc9c8175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9c7fff6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c80fe780 0x7fc9c80fec20 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9bc00a9b0 tx=0x7fc9bc0055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9bc003a30 con 0x7fc9c80fe780 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c81038b0 con 0x7fc9c80fe780 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fc9bc003b90 con 0x7fc9c80fe780 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc9bc0372f0 con 0x7fc9c80fe780 2026-02-19T21:04:43.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f2d000043b0 con 0x7f2d101208a0 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c8103d80 con 0x7fc9c80fe780 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.212+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c81104d0 con 0x7fc9c80fe780 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.213+0000 7f2d077fe6c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ce00b5870 0x7f2ce00d5d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.213+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2d000e3d80 con 0x7f2d101208a0 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.213+0000 7f2d0e5756c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ce00b5870 0x7f2ce00d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.213+0000 7f2d0e5756c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ce00b5870 0x7f2ce00d5d20 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf800a340 tx=0x7f2cf800a520 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.214+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2d000a65d0 con 0x7f2d101208a0 2026-02-19T21:04:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.214+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fc9bc0081c0 con 0x7fc9c80fe780 2026-02-19T21:04:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.215+0000 7fc9c4ff96c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc99c0b57e0 0x7fc99c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.215+0000 7fc9c77fe6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc99c0b57e0 0x7fc99c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.215+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fc9bc108d10 con 0x7fc9c80fe780 2026-02-19T21:04:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.215+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc9bc0cb560 con 0x7fc9c80fe780 2026-02-19T21:04:43.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.215+0000 7fc9c77fe6c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc99c0b57e0 0x7fc99c0d5c90 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9b4005b40 tx=0x7fc9b4009310 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.252+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f32e411cd70 con 0x7f32e4115410 2026-02-19T21:04:43.254 INFO:teuthology.orchestra.run.trial090.stdout:34359738390 2026-02-19T21:04:43.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.252+0000 7f32d9ffb6c0 1 -- 10.20.193.90:0/953808560 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f32cc00ce60 con 0x7f32e4115410 2026-02-19T21:04:43.256 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f32c00b5760 msgr2=0x7f32c00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.256 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f32c00b5760 0x7f32c00d5c10 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d4005980 tx=0x7f32d4005910 comp rx=0 tx=0).stop 2026-02-19T21:04:43.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 msgr2=0x7f32e411c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e411c130 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32cc00b6c0 tx=0x7f32cc00bb90 comp rx=0 tx=0).stop 2026-02-19T21:04:43.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 shutdown_connections 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f32c00b5760 0x7f32c00d5c10 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f32e41214f0 0x7f32e4121990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f32e4115410 0x7f32e411c130 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 --2- 10.20.193.90:0/953808560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f32e410f200 0x7f32e411bbf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.254+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 >> 10.20.193.90:0/953808560 conn(0x7f32e40ecac0 msgr2=0x7f32e410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.256+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 shutdown_connections 2026-02-19T21:04:43.258 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.256+0000 7f32eae456c0 1 -- 10.20.193.90:0/953808560 wait complete. 2026-02-19T21:04:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.257+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7feb5010fbf0 con 0x7feb50115410 2026-02-19T21:04:43.259 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.257+0000 7feb2ffff6c0 1 -- 10.20.193.90:0/3510167347 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7feb380a9690 con 0x7feb50115410 2026-02-19T21:04:43.259 INFO:teuthology.orchestra.run.trial090.stdout:128849018896 2026-02-19T21:04:43.260 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.259+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbcec10f5b0 con 0x7fbcec05db00 2026-02-19T21:04:43.261 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.259+0000 7fbce1ffb6c0 1 -- 10.20.193.90:0/3440749766 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbce80aa530 con 0x7fbcec05db00 2026-02-19T21:04:43.261 INFO:teuthology.orchestra.run.trial090.stdout:98784247826 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feb240b5760 msgr2=0x7feb240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feb240b5760 0x7feb240d5c10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb440023e0 tx=0x7feb44005ae0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb50115410 msgr2=0x7feb50062950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb50115410 0x7feb50062950 secure :-1 s=READY pgs=270 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb38004750 tx=0x7feb3800bed0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 shutdown_connections 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feb240b5760 0x7feb240d5c10 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7feb50062f30 0x7feb500633d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7feb50115410 0x7feb50062950 unknown :-1 s=CLOSED pgs=270 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 --2- 10.20.193.90:0/3510167347 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7feb5010f200 0x7feb500666f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 >> 10.20.193.90:0/3510167347 conn(0x7feb500ecac0 msgr2=0x7feb5010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 shutdown_connections 2026-02-19T21:04:43.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.260+0000 7feb5509f6c0 1 -- 10.20.193.90:0/3510167347 wait complete. 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbcc80b57e0 msgr2=0x7fbcc80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbcc80b57e0 0x7fbcc80d5c90 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbcdc0097f0 tx=0x7fbcdc005910 comp rx=0 tx=0).stop 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec05db00 msgr2=0x7fbcec1002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec05db00 0x7fbcec1002c0 secure :-1 s=READY pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbce8006fd0 tx=0x7fbce800cc00 comp rx=0 tx=0).stop 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 shutdown_connections 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbcc80b57e0 0x7fbcc80d5c90 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbcec05db00 0x7fbcec1002c0 unknown :-1 s=CLOSED pgs=71 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbcec1153f0 0x7fbcec175c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 --2- 10.20.193.90:0/3440749766 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbcec10f1e0 0x7fbcec05d4d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 >> 10.20.193.90:0/3440749766 conn(0x7fbcec0ecac0 msgr2=0x7fbcec113a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 shutdown_connections 2026-02-19T21:04:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.262+0000 7fbcf326b6c0 1 -- 10.20.193.90:0/3440749766 wait complete. 2026-02-19T21:04:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.263+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f433c122910 con 0x7f433c113760 2026-02-19T21:04:43.265 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.263+0000 7f43237fe6c0 1 -- 10.20.193.90:0/2850928029 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f43300ca7c0 con 0x7f433c113760 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2026-02-19T21:04:43.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: osdmap e76: 12 total, 12 up, 12 in 2026-02-19T21:04:43.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2227958270' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:43.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:42 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/77448472' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-19T21:04:43.267 INFO:teuthology.orchestra.run.trial090.stdout:300647710725 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43140b57e0 msgr2=0x7f43140d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43140b57e0 0x7f43140d5c90 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4324005980 tx=0x7f4324005910 comp rx=0 tx=0).stop 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 msgr2=0x7f433c1217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c1217c0 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43300092b0 tx=0x7f433002fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 shutdown_connections 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43140b57e0 0x7f43140d5c90 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f433c1270c0 0x7f433c127560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f433c1198b0 0x7f433c121d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 --2- 10.20.193.90:0/2850928029 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f433c113760 0x7f433c1217c0 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 >> 10.20.193.90:0/2850928029 conn(0x7f433c060720 msgr2=0x7f433c115920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 shutdown_connections 2026-02-19T21:04:43.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.266+0000 7f4340b7b6c0 1 -- 10.20.193.90:0/2850928029 wait complete. 2026-02-19T21:04:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/1016245002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c115410 msgr2=0x7f981c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/1016245002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c115410 0x7f981c175db0 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=7960447387262548490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f980c00aa40 tx=0x7f980c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/1016245002 shutdown_connections 2026-02-19T21:04:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/1016245002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c115410 0x7f981c175db0 unknown :-1 s=CLOSED pgs=72 gs=1 cs=0 l=1 c_cookie=7960447387262548490 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/1016245002 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f981c10fbf0 0x7f981c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/1016245002 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c10f200 0x7f981c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/1016245002 >> 10.20.193.90:0/1016245002 conn(0x7f981c0ecac0 msgr2=0x7f981c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/1016245002 shutdown_connections 2026-02-19T21:04:43.276 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.273+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/1016245002 wait complete. 2026-02-19T21:04:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 Processor -- start 2026-02-19T21:04:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 -- start start 2026-02-19T21:04:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f981c10f200 0x7f981c11a2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c115410 0x7f981c11a810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 0x7f981c120070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f981c1205e0 con 0x7f981c10f200 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f981c120750 con 0x7f981c11fbd0 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9820a9d6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f981c120910 con 0x7f981c115410 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981a5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f981c10f200 0x7f981c11a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9819d746c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c115410 0x7f981c11a810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 0x7f981c120070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 0x7f981c120070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:41014/0 (socket says 10.20.193.90:41014) 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 -- 10.20.193.90:0/3455835842 learned_addr learned my addr 10.20.193.90:0/3455835842 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 -- 10.20.193.90:0/3455835842 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c115410 msgr2=0x7f981c11a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c115410 0x7f981c11a810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 -- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f981c10f200 msgr2=0x7f981c11a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f981c10f200 0x7f981c11a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 -- 10.20.193.90:0/3455835842 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c00a660 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f9819d746c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c115410 0x7f981c11a810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.274+0000 7f981ad766c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 0x7f981c120070 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f980c00a390 tx=0x7f980c0054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.275+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f980c030ea0 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.275+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f980c005760 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.275+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f980c008260 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.275+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c160d60 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.275+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c161190 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.275+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c1104d0 con 0x7f981c11fbd0 2026-02-19T21:04:43.280 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.276+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f980c003810 con 0x7f981c11fbd0 2026-02-19T21:04:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.277+0000 7f98037fe6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f97f40b5760 0x7f97f40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.277+0000 7f981a5756c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f97f40b5760 0x7f97f40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.277+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f980c108ff0 con 0x7f981c11fbd0 2026-02-19T21:04:43.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.278+0000 7f981a5756c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f97f40b5760 0x7f97f40d5c10 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9810004750 tx=0x7f9810009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:43.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.279+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f980c0cb840 con 0x7f981c11fbd0 2026-02-19T21:04:43.305 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.303+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff7e8162600 con 0x7ff7e8060760 2026-02-19T21:04:43.306 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.304+0000 7ff7d6ffd6c0 1 -- 10.20.193.90:0/1252284923 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff7d800ce60 con 0x7ff7e8060760 2026-02-19T21:04:43.306 INFO:teuthology.orchestra.run.trial090.stdout:253403070473 2026-02-19T21:04:43.307 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738391 got 34359738390 for osd.0 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7c40b5760 msgr2=0x7ff7c40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7c40b5760 0x7ff7c40d5c10 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7dc0098c0 tx=0x7ff7dc0091a0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 msgr2=0x7ff7e81614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 0x7ff7e81614b0 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff7d800b710 tx=0x7ff7d800bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 shutdown_connections 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7c40b5760 0x7ff7c40d5c10 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff7e8155620 0x7ff7e8166db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff7e8061070 0x7ff7e81619f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.310 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 --2- 10.20.193.90:0/1252284923 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff7e8060760 0x7ff7e81614b0 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.310 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 >> 10.20.193.90:0/1252284923 conn(0x7ff7e80ea870 msgr2=0x7ff7e810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.310 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 shutdown_connections 2026-02-19T21:04:43.310 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.307+0000 7ff7efcff6c0 1 -- 10.20.193.90:0/1252284923 wait complete. 2026-02-19T21:04:43.313 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018897 got 128849018896 for osd.4 2026-02-19T21:04:43.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.313+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbeb40eacc0 con 0x7fbeb405f7d0 2026-02-19T21:04:43.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.314+0000 7fbea2ffd6c0 1 -- 10.20.193.90:0/3850499290 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbea40abff0 con 0x7fbeb405f7d0 2026-02-19T21:04:43.316 INFO:teuthology.orchestra.run.trial090.stdout:51539607572 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbe900b5760 msgr2=0x7fbe900d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbe900b5760 0x7fbe900d5c10 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea8005b40 tx=0x7fbea8005c40 comp rx=0 tx=0).stop 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 msgr2=0x7fbeb40ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 0x7fbeb40ed760 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea4005dc0 tx=0x7fbea400bbb0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 shutdown_connections 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbe900b5760 0x7fbe900d5c10 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbeb40e99c0 0x7fbeb40e9e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbeb4112fb0 0x7fbeb4173850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 --2- 10.20.193.90:0/3850499290 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbeb405f7d0 0x7fbeb40ed760 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 >> 10.20.193.90:0/3850499290 conn(0x7fbeb40e9520 msgr2=0x7fbeb410a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 shutdown_connections 2026-02-19T21:04:43.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.316+0000 7fbebaa4b6c0 1 -- 10.20.193.90:0/3850499290 wait complete. 2026-02-19T21:04:43.320 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247826 for osd.3 2026-02-19T21:04:43.320 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.317+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fa77810fbf0 con 0x7fa77810f200 2026-02-19T21:04:43.321 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.318+0000 7fa76dffb6c0 1 -- 10.20.193.90:0/2613399413 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa7680cd9c0 con 0x7fa77810f200 2026-02-19T21:04:43.321 INFO:teuthology.orchestra.run.trial090.stdout:223338299403 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7540b57e0 msgr2=0x7fa7540d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7540b57e0 0x7fa7540d5c90 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa760005dc0 tx=0x7fa760005d10 comp rx=0 tx=0).stop 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 msgr2=0x7fa77811d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 0x7fa77811d330 secure :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa768031fd0 tx=0x7fa76802fbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 shutdown_connections 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7540b57e0 0x7fa7540d5c90 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa778122c30 0x7fa7781230d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa778115410 0x7fa77811d870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.322 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 --2- 10.20.193.90:0/2613399413 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa77810f200 0x7fa77811d330 unknown :-1 s=CLOSED pgs=73 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 >> 10.20.193.90:0/2613399413 conn(0x7fa7780ecac0 msgr2=0x7fa77810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 shutdown_connections 2026-02-19T21:04:43.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.320+0000 7fa77ee306c0 1 -- 10.20.193.90:0/2613399413 wait complete. 2026-02-19T21:04:43.323 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.322+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb5e40ff930 con 0x7fb5e40f9960 2026-02-19T21:04:43.324 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.322+0000 7fb5d27fc6c0 1 -- 10.20.193.90:0/3429242720 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5e40ff930 con 0x7fb5e40f9960 2026-02-19T21:04:43.324 INFO:teuthology.orchestra.run.trial090.stdout:68719476756 2026-02-19T21:04:43.326 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7ff390122c20 con 0x7ff39010c460 2026-02-19T21:04:43.326 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2d1010f5d0 con 0x7f2d101208a0 2026-02-19T21:04:43.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb5c00b5760 msgr2=0x7fb5c00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb5c00b5760 0x7fb5c00d5c10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5d4004750 tx=0x7fb5d4009260 comp rx=0 tx=0).stop 2026-02-19T21:04:43.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 msgr2=0x7fb5e40feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 0x7fb5e40feac0 secure :-1 s=READY pgs=279 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5e000c6c0 tx=0x7fb5e000cb90 comp rx=0 tx=0).stop 2026-02-19T21:04:43.327 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.324+0000 7ff37effd6c0 1 -- 10.20.193.90:0/3866304372 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff3840a9700 con 0x7ff39010c460 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 shutdown_connections 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb5c00b5760 0x7fb5c00d5c10 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb5e40f9960 0x7fb5e40feac0 unknown :-1 s=CLOSED pgs=279 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb5e4113180 0x7fb5e4173a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 --2- 10.20.193.90:0/3429242720 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb5e410cf70 0x7fb5e40f9330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 >> 10.20.193.90:0/3429242720 conn(0x7fb5e40ea870 msgr2=0x7fb5e410f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.328 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7f2d077fe6c0 1 -- 10.20.193.90:0/4211710263 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2d000028c0 con 0x7f2d101208a0 2026-02-19T21:04:43.329 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 shutdown_connections 2026-02-19T21:04:43.329 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fb5eb7dc6c0 1 -- 10.20.193.90:0/3429242720 wait complete. 2026-02-19T21:04:43.329 INFO:teuthology.orchestra.run.trial090.stdout:270582939655 2026-02-19T21:04:43.329 INFO:teuthology.orchestra.run.trial090.stdout:146028888078 2026-02-19T21:04:43.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.325+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc9c805dfd0 con 0x7fc9c80fe780 2026-02-19T21:04:43.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.326+0000 7fc9c4ff96c0 1 -- 10.20.193.90:0/1743695214 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9bc0ce710 con 0x7fc9c80fe780 2026-02-19T21:04:43.330 INFO:teuthology.orchestra.run.trial090.stdout:176093659150 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff36c0b5760 msgr2=0x7ff36c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff36c0b5760 0x7ff36c0d5c10 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3800023e0 tx=0x7ff380031f10 comp rx=0 tx=0).stop 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 msgr2=0x7ff390122010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 0x7ff390122010 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff384009490 tx=0x7ff38400bca0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 shutdown_connections 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff36c0b5760 0x7ff36c0d5c10 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff390111080 0x7ff3901273d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff39010c460 0x7ff390122010 unknown :-1 s=CLOSED pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7ff397f116c0 1 --2- 10.20.193.90:0/3866304372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff39010ba70 0x7ff390121ad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 >> 10.20.193.90:0/3866304372 conn(0x7ff3900e96c0 msgr2=0x7ff390109aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ce00b5870 msgr2=0x7f2ce00d5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.327+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ce00b5870 0x7f2ce00d5d20 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf800a340 tx=0x7f2cf800a520 comp rx=0 tx=0).stop 2026-02-19T21:04:43.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d101208a0 msgr2=0x7f2d10120d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.332 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d101208a0 0x7f2d10120d40 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d0000b9b0 tx=0x7f2d0000be80 comp rx=0 tx=0).stop 2026-02-19T21:04:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 shutdown_connections 2026-02-19T21:04:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7ff397f116c0 1 -- 10.20.193.90:0/3866304372 wait complete. 2026-02-19T21:04:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 shutdown_connections 2026-02-19T21:04:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2ce00b5870 0x7f2ce00d5d20 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d101208a0 0x7f2d10120d40 unknown :-1 s=CLOSED pgs=74 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d10115410 0x7f2d1011b4e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 --2- 10.20.193.90:0/4211710263 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d1010f200 0x7f2d1011afa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 >> 10.20.193.90:0/4211710263 conn(0x7f2d100ecac0 msgr2=0x7f2d1010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 shutdown_connections 2026-02-19T21:04:43.334 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.328+0000 7f2d14b476c0 1 -- 10.20.193.90:0/4211710263 wait complete. 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc99c0b57e0 msgr2=0x7fc99c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc99c0b57e0 0x7fc99c0d5c90 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9b4005b40 tx=0x7fc9b4009310 comp rx=0 tx=0).stop 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c80fe780 msgr2=0x7fc9c80fec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c80fe780 0x7fc9c80fec20 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc9bc00a9b0 tx=0x7fc9bc0055e0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 shutdown_connections 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fc99c0b57e0 0x7fc99c0d5c90 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fc9c80fe780 0x7fc9c80fec20 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fc9c8115410 0x7fc9c8175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 --2- 10.20.193.90:0/1743695214 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fc9c810f200 0x7fc9c80fe240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 >> 10.20.193.90:0/1743695214 conn(0x7fc9c80eca60 msgr2=0x7fc9c8110d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 shutdown_connections 2026-02-19T21:04:43.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.329+0000 7fc9cde046c0 1 -- 10.20.193.90:0/1743695214 wait complete. 2026-02-19T21:04:43.338 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710727 got 300647710725 for osd.11 2026-02-19T21:04:43.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070475 got 253403070473 for osd.9 2026-02-19T21:04:43.372 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607574 got 51539607572 for osd.1 2026-02-19T21:04:43.386 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476757 got 68719476756 for osd.2 2026-02-19T21:04:43.389 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888078 for osd.5 2026-02-19T21:04:43.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.388+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f981c10f5d0 con 0x7f981c11fbd0 2026-02-19T21:04:43.390 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.389+0000 7f98037fe6c0 1 -- 10.20.193.90:0/3455835842 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f980c0ce9f0 con 0x7f981c11fbd0 2026-02-19T21:04:43.391 INFO:teuthology.orchestra.run.trial090.stdout:193273528331 2026-02-19T21:04:43.393 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299404 got 223338299403 for osd.8 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f97f40b5760 msgr2=0x7f97f40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f97f40b5760 0x7f97f40d5c10 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9810004750 tx=0x7f9810009260 comp rx=0 tx=0).stop 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 msgr2=0x7f981c120070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 0x7f981c120070 secure :-1 s=READY pgs=73 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f980c00a390 tx=0x7f980c0054b0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 shutdown_connections 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f97f40b5760 0x7f97f40d5c10 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f981c11fbd0 0x7f981c120070 unknown :-1 s=CLOSED pgs=73 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.394 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f981c115410 0x7f981c11a810 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.395 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 --2- 10.20.193.90:0/3455835842 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f981c10f200 0x7f981c11a2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:43.395 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 >> 10.20.193.90:0/3455835842 conn(0x7f981c0ecac0 msgr2=0x7f981c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:43.395 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 shutdown_connections 2026-02-19T21:04:43.395 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:43.391+0000 7f9820a9d6c0 1 -- 10.20.193.90:0/3455835842 wait complete. 2026-02-19T21:04:43.399 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939656 got 270582939655 for osd.10 2026-02-19T21:04:43.405 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659151 got 176093659150 for osd.6 2026-02-19T21:04:43.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528333 got 193273528331 for osd.7 2026-02-19T21:04:44.056 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: osdmap e77: 12 total, 12 up, 12 in 2026-02-19T21:04:44.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: pgmap v183: 97 pgs: 1 activating, 1 active+recovery_wait+degraded, 95 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 21 op/s; 1/192 objects degraded (0.521%); 6.4 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:44.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/953808560' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-19T21:04:44.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3510167347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-19T21:04:44.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3440749766' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-19T21:04:44.057 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2850928029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1252284923' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3850499290' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2613399413' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3429242720' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3866304372' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4211710263' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1743695214' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-19T21:04:44.058 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3455835842' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-19T21:04:44.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: osdmap e77: 12 total, 12 up, 12 in 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: pgmap v183: 97 pgs: 1 activating, 1 active+recovery_wait+degraded, 95 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 21 op/s; 1/192 objects degraded (0.521%); 6.4 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/953808560' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3510167347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3440749766' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2850928029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1252284923' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3850499290' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2613399413' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3429242720' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3866304372' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-19T21:04:44.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4211710263' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-19T21:04:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1743695214' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-19T21:04:44.147 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3455835842' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-19T21:04:44.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: osdmap e77: 12 total, 12 up, 12 in 2026-02-19T21:04:44.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: pgmap v183: 97 pgs: 1 activating, 1 active+recovery_wait+degraded, 95 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 12 KiB/s wr, 21 op/s; 1/192 objects degraded (0.521%); 6.4 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:44.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/953808560' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-19T21:04:44.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3510167347' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-19T21:04:44.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3440749766' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-19T21:04:44.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2850928029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-19T21:04:44.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1252284923' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-19T21:04:44.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3850499290' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-19T21:04:44.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2613399413' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-19T21:04:44.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3429242720' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-19T21:04:44.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3866304372' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-19T21:04:44.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4211710263' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-19T21:04:44.268 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1743695214' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-19T21:04:44.269 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3455835842' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-19T21:04:44.308 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-19T21:04:44.314 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-19T21:04:44.321 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-19T21:04:44.338 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-19T21:04:44.367 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-19T21:04:44.373 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-19T21:04:44.386 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-19T21:04:44.389 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-19T21:04:44.394 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-19T21:04:44.401 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-19T21:04:44.406 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-19T21:04:44.434 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-19T21:04:44.439 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.485 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.486 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.488 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.537 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.538 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.538 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.542 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.543 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 -- 10.20.193.90:0/4198511384 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 msgr2=0x7f0850155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/4198511384 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f0850155260 secure :-1 s=READY pgs=74 gs=3 cs=0 l=1 c_cookie=6790039335689070979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08440098a0 tx=0x7f084402ec40 comp rx=0 tx=0).stop 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 -- 10.20.193.90:0/4198511384 shutdown_connections 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/4198511384 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f08501557a0 0x7f0850175b80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/4198511384 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f0850155260 unknown :-1 s=CLOSED pgs=74 gs=3 cs=0 l=1 c_cookie=6790039335689070979 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/4198511384 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f085010ba70 0x7f085010be40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 -- 10.20.193.90:0/4198511384 >> 10.20.193.90:0/4198511384 conn(0x7f08500e96f0 msgr2=0x7f0850109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.574+0000 7f08583dc6c0 1 -- 10.20.193.90:0/4198511384 shutdown_connections 2026-02-19T21:04:44.578 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 -- 10.20.193.90:0/4198511384 wait complete. 2026-02-19T21:04:44.580 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 Processor -- start 2026-02-19T21:04:44.580 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 -- start start 2026-02-19T21:04:44.580 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f085010ba70 0x7f08500ebcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.580 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f08500ec200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.580 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08501557a0 0x7f08500f15c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.580 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08500f1c10 con 0x7f08501557a0 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08500f1d80 con 0x7f085010c380 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.575+0000 7f08583dc6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f08500f1f40 con 0x7f085010ba70 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.576+0000 7f08569526c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08501557a0 0x7f08500f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.576+0000 7f08569526c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08501557a0 0x7f08500f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43020/0 (socket says 10.20.193.90:43020) 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.576+0000 7f08561516c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f085010ba70 0x7f08500ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.576+0000 7f08569526c0 1 -- 10.20.193.90:0/1675077851 learned_addr learned my addr 10.20.193.90:0/1675077851 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.576+0000 7f08559506c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f08500ec200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.576+0000 7f08561516c0 1 -- 10.20.193.90:0/1675077851 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 msgr2=0x7f08500ec200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08561516c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f08500ec200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08561516c0 1 -- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08501557a0 msgr2=0x7f08500f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.581 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08561516c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08501557a0 0x7f08500f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08561516c0 1 -- 10.20.193.90:0/1675077851 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08440094c0 con 0x7f085010ba70 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08559506c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f08500ec200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08561516c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f085010ba70 0x7f08500ebcc0 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0840004750 tx=0x7f084000bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0840004a80 con 0x7f085010ba70 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0840009030 con 0x7f085010ba70 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08500f2220 con 0x7f085010ba70 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0840005570 con 0x7f085010ba70 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.577+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0850150e70 con 0x7f085010ba70 2026-02-19T21:04:44.582 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.579+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085005fad0 con 0x7f085010ba70 2026-02-19T21:04:44.583 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.579+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f084000c7a0 con 0x7f085010ba70 2026-02-19T21:04:44.583 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.580+0000 7f08377fe6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f082c0b57e0 0x7f082c0d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.583 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.580+0000 7f08559506c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f082c0b57e0 0x7f082c0d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.584 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.581+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f08400e3d10 con 0x7f085010ba70 2026-02-19T21:04:44.584 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.581+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f08400a9fc0 con 0x7f085010ba70 2026-02-19T21:04:44.584 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.581+0000 7f08559506c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f082c0b57e0 0x7f082c0d5c90 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08440023e0 tx=0x7f0844005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.590 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.593 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.596 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:44.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 -- 10.20.193.90:0/4294879372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c114690 msgr2=0x7f391c15ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 --2- 10.20.193.90:0/4294879372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c114690 0x7f391c15ba70 secure :-1 s=READY pgs=75 gs=3 cs=0 l=1 c_cookie=4780778026541585089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39040098a0 tx=0x7f390402ec40 comp rx=0 tx=0).stop 2026-02-19T21:04:44.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 -- 10.20.193.90:0/4294879372 shutdown_connections 2026-02-19T21:04:44.626 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 --2- 10.20.193.90:0/4294879372 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c15bfb0 0x7f391c17c390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 --2- 10.20.193.90:0/4294879372 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c114690 0x7f391c15ba70 unknown :-1 s=CLOSED pgs=75 gs=3 cs=0 l=1 c_cookie=4780778026541585089 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 --2- 10.20.193.90:0/4294879372 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 0x7f391c114150 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 -- 10.20.193.90:0/4294879372 >> 10.20.193.90:0/4294879372 conn(0x7f391c0589f0 msgr2=0x7f391c058df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 -- 10.20.193.90:0/4294879372 shutdown_connections 2026-02-19T21:04:44.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f39215036c0 1 -- 10.20.193.90:0/4294879372 wait complete. 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3206259758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f779810f200 msgr2=0x7f779810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3206259758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f779810f200 0x7f779810f5d0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=14924566380325661198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77880099a0 tx=0x7f778802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3206259758 shutdown_connections 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3206259758 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7798115410 0x7f7798175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3206259758 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810fbf0 0x7f7798114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3206259758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f779810f200 0x7f779810f5d0 unknown :-1 s=CLOSED pgs=283 gs=1 cs=0 l=1 c_cookie=14924566380325661198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3206259758 >> 10.20.193.90:0/3206259758 conn(0x7f77980ecac0 msgr2=0x7f779810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3206259758 shutdown_connections 2026-02-19T21:04:44.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.624+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3206259758 wait complete. 2026-02-19T21:04:44.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 Processor -- start 2026-02-19T21:04:44.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 -- start start 2026-02-19T21:04:44.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 0x7f391c104170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c114690 0x7f391c1046b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c15bfb0 0x7f391c109a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10a0c0 con 0x7f391c114690 2026-02-19T21:04:44.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10a230 con 0x7f391c15bfb0 2026-02-19T21:04:44.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f39215036c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10a3f0 con 0x7f391c113d80 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 Processor -- start 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 -- start start 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810f200 0x7f77980fe2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7798115410 0x7f7798175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77980fe7e0 0x7f77980fec80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77981032f0 con 0x7f77980fe7e0 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7798103460 con 0x7f7798115410 2026-02-19T21:04:44.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ecf06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7798103620 con 0x7f779810f200 2026-02-19T21:04:44.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391affd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 0x7f391c104170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391a7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c114690 0x7f391c1046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391affd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 0x7f391c104170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:57900/0 (socket says 10.20.193.90:57900) 2026-02-19T21:04:44.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391affd6c0 1 -- 10.20.193.90:0/3010870867 learned_addr learned my addr 10.20.193.90:0/3010870867 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391b7fe6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c15bfb0 0x7f391c109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391a7fc6c0 1 -- 10.20.193.90:0/3010870867 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 msgr2=0x7f391c104170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391a7fc6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 0x7f391c104170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391a7fc6c0 1 -- 10.20.193.90:0/3010870867 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c15bfb0 msgr2=0x7f391c109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391a7fc6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c15bfb0 0x7f391c109a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779d2666c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77980fe7e0 0x7f77980fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391a7fc6c0 1 -- 10.20.193.90:0/3010870867 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c00a660 con 0x7f391c114690 2026-02-19T21:04:44.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f391b7fe6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c15bfb0 0x7f391c109a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:44.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779d2666c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77980fe7e0 0x7f77980fec80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43074/0 (socket says 10.20.193.90:43074) 2026-02-19T21:04:44.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779d2666c0 1 -- 10.20.193.90:0/3139917406 learned_addr learned my addr 10.20.193.90:0/3139917406 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.625+0000 7f779ca656c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810f200 0x7f77980fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ca656c0 1 -- 10.20.193.90:0/3139917406 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7798115410 msgr2=0x7f7798175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ca656c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7798115410 0x7f7798175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f391a7fc6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c114690 0x7f391c1046b0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39040098a0 tx=0x7f390402fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3904002ae0 con 0x7f391c114690 2026-02-19T21:04:44.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ca656c0 1 -- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77980fe7e0 msgr2=0x7f77980fec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3904005d50 con 0x7f391c114690 2026-02-19T21:04:44.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3904037070 con 0x7f391c114690 2026-02-19T21:04:44.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39040094c0 con 0x7f391c114690 2026-02-19T21:04:44.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ca656c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77980fe7e0 0x7f77980fec80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ca656c0 1 -- 10.20.193.90:0/3139917406 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7788009590 con 0x7f779810f200 2026-02-19T21:04:44.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391c0fbb50 con 0x7f391c114690 2026-02-19T21:04:44.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ca656c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810f200 0x7f77980fe2a0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7788004830 tx=0x7f778802fd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7788002c20 con 0x7f779810f200 2026-02-19T21:04:44.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7788002d80 con 0x7f779810f200 2026-02-19T21:04:44.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7788036380 con 0x7f779810f200 2026-02-19T21:04:44.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77981038a0 con 0x7f779810f200 2026-02-19T21:04:44.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7798103cd0 con 0x7f779810f200 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2978799993 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010bdd0 msgr2=0x7f69d0110bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.626+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2978799993 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010bdd0 0x7f69d0110bb0 secure :-1 s=READY pgs=284 gs=2 cs=0 l=1 c_cookie=12934795119565639297 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69c40075d0 tx=0x7f69c402fe50 comp rx=0 tx=0).stop 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2978799993 shutdown_connections 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2978799993 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69d0111390 0x7f69d0171d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2978799993 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010bdd0 0x7f69d0110bb0 unknown :-1 s=CLOSED pgs=284 gs=2 cs=0 l=1 c_cookie=12934795119565639297 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2978799993 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69d010b430 0x7f69d010b800 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2978799993 >> 10.20.193.90:0/2978799993 conn(0x7f69d0063a80 msgr2=0x7f69d0064270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.640 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2978799993 shutdown_connections 2026-02-19T21:04:44.640 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2978799993 wait complete. 2026-02-19T21:04:44.640 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c10a910 con 0x7f391c114690 2026-02-19T21:04:44.640 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 Processor -- start 2026-02-19T21:04:44.641 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f69d7c406c0 1 -- start start 2026-02-19T21:04:44.641 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.627+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77981104d0 con 0x7f779810f200 2026-02-19T21:04:44.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d7c406c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 0x7f69d00ef5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d7c406c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69d010bdd0 0x7f69d0171c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d7c406c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69d0111390 0x7f69d00efcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d7c406c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0179290 con 0x7f69d010b430 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d7c406c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69d0179400 con 0x7f69d0111390 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d7c406c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f69d01795c0 con 0x7f69d010bdd0 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 0x7f69d00ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 0x7f69d00ef5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43076/0 (socket says 10.20.193.90:43076) 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 -- 10.20.193.90:0/2525635047 learned_addr learned my addr 10.20.193.90:0/2525635047 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d51b46c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69d010bdd0 0x7f69d0171c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d61b66c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69d0111390 0x7f69d00efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 -- 10.20.193.90:0/2525635047 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69d010bdd0 msgr2=0x7f69d0171c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69d010bdd0 0x7f69d0171c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 -- 10.20.193.90:0/2525635047 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69d0111390 msgr2=0x7f69d00efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69d0111390 0x7f69d00efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 -- 10.20.193.90:0/2525635047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c40071c0 con 0x7f69d010b430 2026-02-19T21:04:44.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f69d59b56c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 0x7f69d00ef5b0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69c00092e0 tx=0x7f69c000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.628+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f77880071c0 con 0x7f779810f200 2026-02-19T21:04:44.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.630+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f3904002c40 con 0x7f391c114690 2026-02-19T21:04:44.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.630+0000 7f38fbfff6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38f00b5760 0x7f38f00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.630+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f3904107c80 con 0x7f391c114690 2026-02-19T21:04:44.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.630+0000 7f778dffb6c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77740b5760 0x7f77740d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.630+0000 7f391affd6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38f00b5760 0x7f38f00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f778ffff6c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77740b5760 0x7f77740d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f7788107f90 con 0x7f779810f200 2026-02-19T21:04:44.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f391affd6c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38f00b5760 0x7f38f00d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39100095c0 tx=0x7f3910009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f778ffff6c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77740b5760 0x7f77740d5c10 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7780005980 tx=0x7f7780005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69c0004250 con 0x7f69d010b430 2026-02-19T21:04:44.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f69c00043b0 con 0x7f69d010b430 2026-02-19T21:04:44.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69c000cd40 con 0x7f69d010b430 2026-02-19T21:04:44.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d01798a0 con 0x7f69d010b430 2026-02-19T21:04:44.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f39040ca510 con 0x7f391c114690 2026-02-19T21:04:44.648 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77880ca870 con 0x7f779810f200 2026-02-19T21:04:44.649 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.631+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d0179d80 con 0x7f69d010b430 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.632+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d017a000 con 0x7f69d010b430 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.632+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f69c00026b0 con 0x7f69d010b430 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.634+0000 7f69beffd6c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69ac0b5830 0x7f69ac0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.634+0000 7f69d51b46c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69ac0b5830 0x7f69ac0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.634+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f69c00e3aa0 con 0x7f69d010b430 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.634+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69c00a6330 con 0x7f69d010b430 2026-02-19T21:04:44.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.634+0000 7f69d51b46c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69ac0b5830 0x7f69ac0d5ce0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69d01761d0 tx=0x7f69c40023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 -- 10.20.193.90:0/2481480824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5288115410 msgr2=0x7f5288175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/2481480824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5288115410 0x7f5288175db0 secure :-1 s=READY pgs=287 gs=1 cs=0 l=1 c_cookie=4670222587926426066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f527c00aa70 tx=0x7f527c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 -- 10.20.193.90:0/2481480824 shutdown_connections 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/2481480824 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5288115410 0x7f5288175db0 unknown :-1 s=CLOSED pgs=287 gs=1 cs=0 l=1 c_cookie=4670222587926426066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/2481480824 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f528810fbf0 0x7f5288114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/2481480824 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f528810f200 0x7f528810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 -- 10.20.193.90:0/2481480824 >> 10.20.193.90:0/2481480824 conn(0x7f52880ecac0 msgr2=0x7f528810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 -- 10.20.193.90:0/2481480824 shutdown_connections 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 -- 10.20.193.90:0/2481480824 wait complete. 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 Processor -- start 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.678+0000 7f528e2e86c0 1 -- start start 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528e2e86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 0x7f528810d070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528e2e86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5288115410 0x7f5288175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528e2e86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f528810a3b0 0x7f528810a850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528e2e86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f528810afe0 con 0x7f528810f200 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528e2e86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f528810b150 con 0x7f528810a3b0 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528e2e86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f52880efec0 con 0x7f5288115410 2026-02-19T21:04:44.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f5287fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 0x7f528810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f528c85a6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f528810a3b0 0x7f528810a850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f5287fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 0x7f528810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43096/0 (socket says 10.20.193.90:43096) 2026-02-19T21:04:44.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f5287fff6c0 1 -- 10.20.193.90:0/440742488 learned_addr learned my addr 10.20.193.90:0/440742488 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.680+0000 7f52877fe6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5288115410 0x7f5288175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f5287fff6c0 1 -- 10.20.193.90:0/440742488 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5288115410 msgr2=0x7f5288175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f5287fff6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5288115410 0x7f5288175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f5287fff6c0 1 -- 10.20.193.90:0/440742488 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f528810a3b0 msgr2=0x7f528810a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f5287fff6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f528810a3b0 0x7f528810a850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f5287fff6c0 1 -- 10.20.193.90:0/440742488 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526c0094c0 con 0x7f528810f200 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f5287fff6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 0x7f528810d070 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f527400b710 tx=0x7f527400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5274004240 con 0x7f528810f200 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f52740043a0 con 0x7f528810f200 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c00a660 con 0x7f528810f200 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52880f04f0 con 0x7f528810f200 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.681+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f527400cd10 con 0x7f528810f200 2026-02-19T21:04:44.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.683+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52881104d0 con 0x7f528810f200 2026-02-19T21:04:44.686 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.684+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f52740026b0 con 0x7f528810f200 2026-02-19T21:04:44.686 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.685+0000 7f52857fa6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f52600b5760 0x7f52600d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.686 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.685+0000 7f52877fe6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f52600b5760 0x7f52600d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.685+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f52740e3c50 con 0x7f528810f200 2026-02-19T21:04:44.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.685+0000 7f52877fe6c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f52600b5760 0x7f52600d5c10 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f528810d5b0 tx=0x7f526c009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.686+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f52740a64e0 con 0x7f528810f200 2026-02-19T21:04:44.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- 10.20.193.90:0/4049679385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff35810ba50 msgr2=0x7ff35810be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/4049679385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff35810ba50 0x7ff35810be20 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=5495002783253481408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff344009970 tx=0x7ff34402ed10 comp rx=0 tx=0).stop 2026-02-19T21:04:44.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- 10.20.193.90:0/4049679385 shutdown_connections 2026-02-19T21:04:44.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/4049679385 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff358155780 0x7ff358175b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/4049679385 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff35810c360 0x7ff358155240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/4049679385 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff35810ba50 0x7ff35810be20 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=5495002783253481408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- 10.20.193.90:0/4049679385 >> 10.20.193.90:0/4049679385 conn(0x7ff3580e96f0 msgr2=0x7ff358109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- 10.20.193.90:0/4049679385 shutdown_connections 2026-02-19T21:04:44.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- 10.20.193.90:0/4049679385 wait complete. 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3543383444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd70115220 msgr2=0x7fdd70175bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3543383444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd70115220 0x7fdd70175bc0 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=3929417163683379335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd6c00aa70 tx=0x7fdd6c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3543383444 shutdown_connections 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3543383444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd70115220 0x7fdd70175bc0 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=3929417163683379335 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3543383444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdd7010fa00 0x7fdd70114a40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3543383444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd7010f010 0x7fdd7010f3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3543383444 >> 10.20.193.90:0/3543383444 conn(0x7fdd700ec890 msgr2=0x7fdd7010cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3543383444 shutdown_connections 2026-02-19T21:04:44.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3543383444 wait complete. 2026-02-19T21:04:44.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 Processor -- start 2026-02-19T21:04:44.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- start start 2026-02-19T21:04:44.691 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff35810ba50 0x7ff3581605e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff35810c360 0x7ff358160b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 0x7ff358165ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff358166530 con 0x7ff358155780 2026-02-19T21:04:44.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3581666a0 con 0x7ff35810ba50 2026-02-19T21:04:44.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7ff35e1296c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff358166860 con 0x7ff35810c360 2026-02-19T21:04:44.692 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.687+0000 7fdd76d086c0 1 Processor -- start 2026-02-19T21:04:44.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 -- start start 2026-02-19T21:04:44.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 0x7ff358165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 0x7ff358165ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43120/0 (socket says 10.20.193.90:43120) 2026-02-19T21:04:44.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 -- 10.20.193.90:0/1776369788 learned_addr learned my addr 10.20.193.90:0/1776369788 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.693 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff3577fe6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff35810ba50 0x7ff3581605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 0x7fdd7011cf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd70115220 0x7fdd7011d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdd70122880 0x7fdd70122d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdd70123290 con 0x7fdd7010f010 2026-02-19T21:04:44.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd70123400 con 0x7fdd70115220 2026-02-19T21:04:44.694 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd76d086c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdd701235c0 con 0x7fdd70122880 2026-02-19T21:04:44.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff356ffd6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff35810c360 0x7ff358160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.695 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 0x7fdd7011cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 0x7fdd7011cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43132/0 (socket says 10.20.193.90:43132) 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 -- 10.20.193.90:0/3285836060 learned_addr learned my addr 10.20.193.90:0/3285836060 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd67fff6c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd70115220 0x7fdd7011d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 -- 10.20.193.90:0/1776369788 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff35810c360 msgr2=0x7ff358160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff35810c360 0x7ff358160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 -- 10.20.193.90:0/1776369788 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff35810ba50 msgr2=0x7ff3581605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.696 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff35810ba50 0x7ff3581605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 -- 10.20.193.90:0/1776369788 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff344009590 con 0x7ff358155780 2026-02-19T21:04:44.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff3577fe6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff35810ba50 0x7ff3581605e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:44.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 -- 10.20.193.90:0/3285836060 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdd70122880 msgr2=0x7fdd70122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdd70122880 0x7fdd70122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 -- 10.20.193.90:0/3285836060 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd70115220 msgr2=0x7fdd7011d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.697 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd70115220 0x7fdd7011d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.698 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 -- 10.20.193.90:0/3285836060 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c00a660 con 0x7fdd7010f010 2026-02-19T21:04:44.698 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff357fff6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 0x7ff358165ee0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff34c006ea0 tx=0x7ff34c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.698 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd67fff6c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd70115220 0x7fdd7011d4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:44.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd74a796c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 0x7fdd7011cf80 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd600092e0 tx=0x7fdd6000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff34c003a30 con 0x7ff358155780 2026-02-19T21:04:44.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff358166b40 con 0x7ff358155780 2026-02-19T21:04:44.699 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff34c0054f0 con 0x7ff358155780 2026-02-19T21:04:44.700 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff34c00dcd0 con 0x7ff358155780 2026-02-19T21:04:44.700 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3581523c0 con 0x7ff358155780 2026-02-19T21:04:44.700 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.688+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd60004250 con 0x7fdd7010f010 2026-02-19T21:04:44.700 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.689+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdd600043b0 con 0x7fdd7010f010 2026-02-19T21:04:44.701 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.689+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd6000cd40 con 0x7fdd7010f010 2026-02-19T21:04:44.701 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.689+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd70163a70 con 0x7fdd7010f010 2026-02-19T21:04:44.701 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.689+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35805faf0 con 0x7ff358155780 2026-02-19T21:04:44.701 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.689+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd70163ed0 con 0x7fdd7010f010 2026-02-19T21:04:44.702 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.690+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f085010be40 con 0x7f085010ba70 2026-02-19T21:04:44.702 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.690+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd701102e0 con 0x7fdd7010f010 2026-02-19T21:04:44.702 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.690+0000 7f08377fe6c0 1 -- 10.20.193.90:0/1675077851 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08400a9710 con 0x7f085010ba70 2026-02-19T21:04:44.703 INFO:teuthology.orchestra.run.trial090.stdout:34359738391 2026-02-19T21:04:44.703 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.690+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7ff34c005030 con 0x7ff358155780 2026-02-19T21:04:44.703 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.691+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fdd600026b0 con 0x7fdd7010f010 2026-02-19T21:04:44.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.691+0000 7fdd65ffb6c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdd4c0b5830 0x7fdd4c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.691+0000 7ff354ff96c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff3300b5760 0x7ff3300d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.691+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ff34c0e4dc0 con 0x7ff358155780 2026-02-19T21:04:44.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.692+0000 7ff3577fe6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff3300b5760 0x7ff3300d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.704 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.692+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff34c0a7610 con 0x7ff358155780 2026-02-19T21:04:44.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.692+0000 7fdd67fff6c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdd4c0b5830 0x7fdd4c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.692+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdd60003030 con 0x7fdd7010f010 2026-02-19T21:04:44.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.692+0000 7ff3577fe6c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff3300b5760 0x7ff3300d5c10 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff344005b40 tx=0x7ff344009200 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.692+0000 7fdd67fff6c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdd4c0b5830 0x7fdd4c0d5ce0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd70123910 tx=0x7fdd58005df0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f082c0b57e0 msgr2=0x7f082c0d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f082c0b57e0 0x7f082c0d5c90 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08440023e0 tx=0x7f0844005910 comp rx=0 tx=0).stop 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f085010ba70 msgr2=0x7f08500ebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f085010ba70 0x7f08500ebcc0 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0840004750 tx=0x7f084000bbf0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 shutdown_connections 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f082c0b57e0 0x7f082c0d5c90 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f08501557a0 0x7f08500f15c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f085010c380 0x7f08500ec200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 --2- 10.20.193.90:0/1675077851 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f085010ba70 0x7f08500ebcc0 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 >> 10.20.193.90:0/1675077851 conn(0x7f08500e96f0 msgr2=0x7f085017cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 shutdown_connections 2026-02-19T21:04:44.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7f08583dc6c0 1 -- 10.20.193.90:0/1675077851 wait complete. 2026-02-19T21:04:44.708 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.694+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdd600a6460 con 0x7fdd7010f010 2026-02-19T21:04:44.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/284736131 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc81198b0 msgr2=0x7f6bc817a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/284736131 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc81198b0 0x7f6bc817a280 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=3874281455359514437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bc400aa40 tx=0x7f6bc402fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/284736131 shutdown_connections 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/284736131 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc81198b0 0x7f6bc817a280 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=3874281455359514437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/284736131 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc8114150 0x7f6bc8119100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/284736131 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6bc8113760 0x7f6bc8113b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/284736131 >> 10.20.193.90:0/284736131 conn(0x7f6bc8060720 msgr2=0x7f6bc8060cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/284736131 shutdown_connections 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.695+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/284736131 wait complete. 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 Processor -- start 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 -- start start 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6bc8113760 0x7f6bc81216d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc81198b0 0x7f6bc8121c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 0x7f6bc8127470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc81279e0 con 0x7f6bc8126fd0 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc8127b50 con 0x7f6bc8113760 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcf0846c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc8127d10 con 0x7f6bc81198b0 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcd5fa6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 0x7f6bc8127470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bbffff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc81198b0 0x7f6bc8121c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bccdf96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6bc8113760 0x7f6bc81216d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcd5fa6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 0x7f6bc8127470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43162/0 (socket says 10.20.193.90:43162) 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bbffff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc81198b0 0x7f6bc8121c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.175:3300/0 says I am v2:10.20.193.90:58002/0 (socket says 10.20.193.90:58002) 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.696+0000 7f6bcd5fa6c0 1 -- 10.20.193.90:0/956828935 learned_addr learned my addr 10.20.193.90:0/956828935 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcd5fa6c0 1 -- 10.20.193.90:0/956828935 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc81198b0 msgr2=0x7f6bc8121c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcd5fa6c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc81198b0 0x7f6bc8121c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcd5fa6c0 1 -- 10.20.193.90:0/956828935 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6bc8113760 msgr2=0x7f6bc81216d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcd5fa6c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6bc8113760 0x7f6bc81216d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcd5fa6c0 1 -- 10.20.193.90:0/956828935 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc400a660 con 0x7f6bc8126fd0 2026-02-19T21:04:44.711 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcd5fa6c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 0x7f6bc8127470 secure :-1 s=READY pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bc400a390 tx=0x7f6bc40054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bc4003c40 con 0x7f6bc8126fd0 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6bc4005760 con 0x7f6bc8126fd0 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc8168160 con 0x7f6bc8126fd0 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bc40372f0 con 0x7f6bc8126fd0 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc81685e0 con 0x7f6bc8126fd0 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2251695362 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20062f90 msgr2=0x7fcc200633c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2251695362 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20062f90 0x7fcc200633c0 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=14579522800970038516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc08009970 tx=0x7fcc0802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2251695362 shutdown_connections 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2251695362 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc20159a50 0x7fcc20179eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2251695362 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20062f90 0x7fcc200633c0 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=14579522800970038516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.712 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2251695362 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc20066960 0x7fcc20062970 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.713 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2251695362 >> 10.20.193.90:0/2251695362 conn(0x7fcc200ecac0 msgr2=0x7fcc2010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.713 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.697+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2251695362 shutdown_connections 2026-02-19T21:04:44.713 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2251695362 wait complete. 2026-02-19T21:04:44.713 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc81149a0 con 0x7f6bc8126fd0 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 Processor -- start 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 -- start start 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc20062f90 0x7fcc20163330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 0x7fcc20163870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc20168c30 0x7fcc201690d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc20169640 con 0x7fcc20159a50 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc201697b0 con 0x7fcc20168c30 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc252d36c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc20169970 con 0x7fcc20062f90 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc1e7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 0x7fcc20163870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc1e7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 0x7fcc20163870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43166/0 (socket says 10.20.193.90:43166) 2026-02-19T21:04:44.714 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc1e7fc6c0 1 -- 10.20.193.90:0/2480326753 learned_addr learned my addr 10.20.193.90:0/2480326753 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc1effd6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc20062f90 0x7fcc20163330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.698+0000 7fcc1f7fe6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc20168c30 0x7fcc201690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7fcc1e7fc6c0 1 -- 10.20.193.90:0/2480326753 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc20062f90 msgr2=0x7fcc20163330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7fcc1e7fc6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc20062f90 0x7fcc20163330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7fcc1e7fc6c0 1 -- 10.20.193.90:0/2480326753 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc20168c30 msgr2=0x7fcc201690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7fcc1e7fc6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc20168c30 0x7fcc201690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7fcc1e7fc6c0 1 -- 10.20.193.90:0/2480326753 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc08009590 con 0x7fcc20159a50 2026-02-19T21:04:44.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7fcc1e7fc6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 0x7fcc20163870 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc08031fd0 tx=0x7fcc0802fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.699+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f6bc4008260 con 0x7f6bc8126fd0 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7f6bbdffb6c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6ba40b5760 0x7f6ba40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f6bc4108f30 con 0x7f6bc8126fd0 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7f6bccdf96c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6ba40b5760 0x7f6ba40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7f6bccdf96c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6ba40b5760 0x7f6ba40d5c10 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bb8004750 tx=0x7f6bb8009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc08002ae0 con 0x7fcc20159a50 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcc08005e90 con 0x7fcc20159a50 2026-02-19T21:04:44.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6bc40cb780 con 0x7f6bc8126fd0 2026-02-19T21:04:44.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc201578b0 con 0x7fcc20159a50 2026-02-19T21:04:44.717 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc08036070 con 0x7fcc20159a50 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.700+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc20157d30 con 0x7fcc20159a50 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.701+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc20063e80 con 0x7fcc20159a50 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.702+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fcc08002c40 con 0x7fcc20159a50 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.703+0000 7fcbfffff6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf40b5760 0x7fcbf40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.704+0000 7fcc1effd6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf40b5760 0x7fcbf40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.704+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fcc08107ef0 con 0x7fcc20159a50 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.704+0000 7fcc1effd6c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf40b5760 0x7fcbf40d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc14004750 tx=0x7fcc14009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.718 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.705+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcc080ce1e0 con 0x7fcc20159a50 2026-02-19T21:04:44.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 -- 10.20.193.90:0/990224013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810d960 msgr2=0x7f14881129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 --2- 10.20.193.90:0/990224013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810d960 0x7f14881129a0 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=2025643752579271387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14700099a0 tx=0x7f147002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:44.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 -- 10.20.193.90:0/990224013 shutdown_connections 2026-02-19T21:04:44.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 --2- 10.20.193.90:0/990224013 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1488113180 0x7f1488173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 --2- 10.20.193.90:0/990224013 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810d960 0x7f14881129a0 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=2025643752579271387 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 --2- 10.20.193.90:0/990224013 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f148810cf70 0x7f148810d340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 -- 10.20.193.90:0/990224013 >> 10.20.193.90:0/990224013 conn(0x7f14880ea870 msgr2=0x7f148810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 -- 10.20.193.90:0/990224013 shutdown_connections 2026-02-19T21:04:44.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f391c05afe0 con 0x7f391c114690 2026-02-19T21:04:44.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 -- 10.20.193.90:0/990224013 wait complete. 2026-02-19T21:04:44.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/4137894264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c115410 msgr2=0x7f0f2c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/4137894264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c115410 0x7f0f2c175db0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=11861257012357122494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f2000aa70 tx=0x7f0f2002fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/4137894264 shutdown_connections 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f38fbfff6c0 1 -- 10.20.193.90:0/3010870867 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39040cd6c0 con 0x7f391c114690 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/4137894264 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c115410 0x7f0f2c175db0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=11861257012357122494 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/4137894264 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f2c10fbf0 0x7f0f2c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/4137894264 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f2c10f200 0x7f0f2c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/4137894264 >> 10.20.193.90:0/4137894264 conn(0x7f0f2c0ecac0 msgr2=0x7f0f2c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/4137894264 shutdown_connections 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/4137894264 wait complete. 2026-02-19T21:04:44.743 INFO:teuthology.orchestra.run.trial090.stdout:98784247828 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 -- 10.20.193.90:0/3217416401 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 msgr2=0x7fd43810d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/3217416401 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd43810d340 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=4724143665698989228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd42c0099a0 tx=0x7fd42c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 -- 10.20.193.90:0/3217416401 shutdown_connections 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/3217416401 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd438113180 0x7fd438173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/3217416401 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd43810d960 0x7fd4381129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/3217416401 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd43810d340 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=4724143665698989228 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 -- 10.20.193.90:0/3217416401 >> 10.20.193.90:0/3217416401 conn(0x7fd4380ea870 msgr2=0x7fd43810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7f148f1506c0 1 Processor -- start 2026-02-19T21:04:44.745 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 -- 10.20.193.90:0/3217416401 shutdown_connections 2026-02-19T21:04:44.745 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.739+0000 7fd43d9086c0 1 -- 10.20.193.90:0/3217416401 wait complete. 2026-02-19T21:04:44.745 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 -- start start 2026-02-19T21:04:44.745 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 Processor -- start 2026-02-19T21:04:44.745 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810cf70 0x7f1488062030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1488113180 0x7f1488173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 -- start start 2026-02-19T21:04:44.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 0x7f1488060a40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1488060f80 con 0x7f148810cf70 2026-02-19T21:04:44.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f14880610f0 con 0x7f14880605a0 2026-02-19T21:04:44.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148f1506c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f14880612b0 con 0x7f1488113180 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 Processor -- start 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f147ffff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1488113180 0x7f1488173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 0x7f1488060a40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148cec56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810cf70 0x7f1488062030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 0x7f1488060a40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.105:3300/0 says I am v2:10.20.193.90:49858/0 (socket says 10.20.193.90:49858) 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 -- 10.20.193.90:0/1835007259 learned_addr learned my addr 10.20.193.90:0/1835007259 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 -- start start 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f2c10f200 0x7f0f2c0f9070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f2c115410 0x7f0f2c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 0x7f0f2c0fe920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c0f9d90 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c0fee60 con 0x7f0f2c115410 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f31e0b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c0ff020 con 0x7f0f2c10f200 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 -- 10.20.193.90:0/1835007259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1488113180 msgr2=0x7f1488173a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1488113180 0x7f1488173a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 -- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810cf70 msgr2=0x7f1488062030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810cf70 0x7f1488062030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 -- 10.20.193.90:0/1835007259 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1470009590 con 0x7f14880605a0 2026-02-19T21:04:44.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f147ffff6c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1488113180 0x7f1488173a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd4380f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd438113180 0x7fd438173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd4380f51f0 0x7fd4380fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4380f58e0 con 0x7fd43810cf70 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4380faa00 con 0x7fd438113180 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd43d9086c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd4380fabc0 con 0x7fd4380f51f0 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f2bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 0x7f0f2c0fe920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f2bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 0x7f0f2c0fe920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43200/0 (socket says 10.20.193.90:43200) 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f2bfff6c0 1 -- 10.20.193.90:0/3299133163 learned_addr learned my addr 10.20.193.90:0/3299133163 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f2affd6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f2c115410 0x7f0f2c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f148d6c66c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 0x7f1488060a40 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1484006ea0 tx=0x7f148400cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd436ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd4380f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd436ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd4380f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43208/0 (socket says 10.20.193.90:43208) 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd436ffd6c0 1 -- 10.20.193.90:0/2102621420 learned_addr learned my addr 10.20.193.90:0/2102621420 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:44.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7f0f2b7fe6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f2c10f200 0x7f0f2c0f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd4367fc6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd438113180 0x7fd438173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.740+0000 7fd4377fe6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd4380f51f0 0x7fd4380fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1484003a30 con 0x7f14880605a0 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f2bfff6c0 1 -- 10.20.193.90:0/3299133163 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f2c10f200 msgr2=0x7f0f2c0f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f2bfff6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f2c10f200 0x7f0f2c0f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f2bfff6c0 1 -- 10.20.193.90:0/3299133163 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f2c115410 msgr2=0x7f0f2c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f2bfff6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f2c115410 0x7f0f2c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f2bfff6c0 1 -- 10.20.193.90:0/3299133163 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2000a660 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd436ffd6c0 1 -- 10.20.193.90:0/2102621420 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd4380f51f0 msgr2=0x7fd4380fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd436ffd6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd4380f51f0 0x7fd4380fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd436ffd6c0 1 -- 10.20.193.90:0/2102621420 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd438113180 msgr2=0x7fd438173a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd436ffd6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd438113180 0x7fd438173a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd436ffd6c0 1 -- 10.20.193.90:0/2102621420 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c009590 con 0x7fd43810cf70 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd4367fc6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd438113180 0x7fd438173a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f14840054f0 con 0x7f14880605a0 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f148400dcd0 con 0x7f14880605a0 2026-02-19T21:04:44.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1488100070 con 0x7f14880605a0 2026-02-19T21:04:44.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881004d0 con 0x7f14880605a0 2026-02-19T21:04:44.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f2bfff6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 0x7f0f2c0fe920 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f200027d0 tx=0x7f0f20005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd436ffd6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd4380f4bc0 secure :-1 s=READY pgs=301 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd42c02f230 tx=0x7fd42c02fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f20003a30 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2c0ff2a0 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0f20003b90 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0f200372f0 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2c0ff720 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd42c002ae0 con 0x7fd43810cf70 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fd42c002c40 con 0x7fd43810cf70 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd42c0362f0 con 0x7fd43810cf70 2026-02-19T21:04:44.754 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4380fae40 con 0x7fd43810cf70 2026-02-19T21:04:44.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f7798060ee0 con 0x7f779810f200 2026-02-19T21:04:44.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4380fb270 con 0x7fd43810cf70 2026-02-19T21:04:44.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f778dffb6c0 1 -- 10.20.193.90:0/3139917406 <== mon.1 v2:10.20.193.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f77880cd990 con 0x7f779810f200 2026-02-19T21:04:44.755 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.741+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148810e240 con 0x7f14880605a0 2026-02-19T21:04:44.756 INFO:teuthology.orchestra.run.trial090.stdout:300647710727 2026-02-19T21:04:44.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.742+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43810e240 con 0x7fd43810cf70 2026-02-19T21:04:44.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.742+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2c1104d0 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.756 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.742+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f1484005030 con 0x7f14880605a0 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38f00b5760 msgr2=0x7f38f00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38f00b5760 0x7f38f00d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39100095c0 tx=0x7f3910009260 comp rx=0 tx=0).stop 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c114690 msgr2=0x7f391c1046b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c114690 0x7f391c1046b0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f39040098a0 tx=0x7f390402fb20 comp rx=0 tx=0).stop 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 shutdown_connections 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38f00b5760 0x7f38f00d5c10 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f391c15bfb0 0x7f391c109a70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f391c114690 0x7f391c1046b0 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 --2- 10.20.193.90:0/3010870867 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f391c113d80 0x7f391c104170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 >> 10.20.193.90:0/3010870867 conn(0x7f391c0589f0 msgr2=0x7f391c0faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 shutdown_connections 2026-02-19T21:04:44.757 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f39215036c0 1 -- 10.20.193.90:0/3010870867 wait complete. 2026-02-19T21:04:44.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f147dffb6c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14640b58b0 0x7f14640d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f14840e4c80 con 0x7f14880605a0 2026-02-19T21:04:44.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f148cec56c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14640b58b0 0x7f14640d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.743+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f0f20008260 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.758 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f148cec56c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14640b58b0 0x7f14640d5d60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1478004750 tx=0x7f1478009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fd42c007810 con 0x7fd43810cf70 2026-02-19T21:04:44.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f0f28ff96c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f000b57e0 0x7f0f000d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f0f20109000 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f0f2b7fe6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f000b57e0 0x7f0f000d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77740b5760 msgr2=0x7f77740d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77740b5760 0x7f77740d5c10 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7780005980 tx=0x7f7780005910 comp rx=0 tx=0).stop 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810f200 msgr2=0x7f77980fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.744+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810f200 0x7f77980fe2a0 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7788004830 tx=0x7f778802fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f14840a74d0 con 0x7f14880605a0 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 shutdown_connections 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77740b5760 0x7f77740d5c10 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f77980fe7e0 0x7f77980fec80 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7798115410 0x7f7798175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 --2- 10.20.193.90:0/3139917406 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f779810f200 0x7f77980fe2a0 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 >> 10.20.193.90:0/3139917406 conn(0x7f77980ecac0 msgr2=0x7f779810d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7fd43c9066c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd40c0b5760 0x7fd40c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:44.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f0f2b7fe6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f000b57e0 0x7f0f000d5c90 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f18004750 tx=0x7f0f18009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 shutdown_connections 2026-02-19T21:04:44.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f779ecf06c0 1 -- 10.20.193.90:0/3139917406 wait complete. 2026-02-19T21:04:44.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7fd4367fc6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd40c0b5760 0x7fd40c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:44.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0f200cb850 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fd42c107e80 con 0x7fd43810cf70 2026-02-19T21:04:44.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.745+0000 7fd4367fc6c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd40c0b5760 0x7fd40c0d5c10 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4380fb550 tx=0x7fd4200092c0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:44.763 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738391 got 34359738391 for osd.0 2026-02-19T21:04:44.763 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.747+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd42c0ca710 con 0x7fd43810cf70 2026-02-19T21:04:44.763 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.763 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.751+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f69d010c410 con 0x7f69d010b430 2026-02-19T21:04:44.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.752+0000 7f69beffd6c0 1 -- 10.20.193.90:0/2525635047 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f69c00a94e0 con 0x7f69d010b430 2026-02-19T21:04:44.764 INFO:teuthology.orchestra.run.trial090.stdout:128849018897 2026-02-19T21:04:44.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.754+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69ac0b5830 msgr2=0x7f69ac0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.754+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69ac0b5830 0x7f69ac0d5ce0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69d01761d0 tx=0x7f69c40023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.754+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 msgr2=0x7f69d00ef5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.764 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.754+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 0x7f69d00ef5b0 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69c00092e0 tx=0x7f69c000bc50 comp rx=0 tx=0).stop 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 shutdown_connections 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f69ac0b5830 0x7f69ac0d5ce0 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f69d0111390 0x7f69d00efcb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f69d010bdd0 0x7f69d0171c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 --2- 10.20.193.90:0/2525635047 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f69d010b430 0x7f69d00ef5b0 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 >> 10.20.193.90:0/2525635047 conn(0x7f69d0063a80 msgr2=0x7f69d010cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 shutdown_connections 2026-02-19T21:04:44.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.755+0000 7f69d7c406c0 1 -- 10.20.193.90:0/2525635047 wait complete. 2026-02-19T21:04:44.790 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247828 got 98784247828 for osd.3 2026-02-19T21:04:44.791 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.796 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710727 got 300647710727 for osd.11 2026-02-19T21:04:44.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.795+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f528810b640 con 0x7f528810f200 2026-02-19T21:04:44.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.795+0000 7f52857fa6c0 1 -- 10.20.193.90:0/440742488 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5274002990 con 0x7f528810f200 2026-02-19T21:04:44.797 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.797 INFO:teuthology.orchestra.run.trial090.stdout:51539607574 2026-02-19T21:04:44.798 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f52600b5760 msgr2=0x7f52600d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.798 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f52600b5760 0x7f52600d5c10 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f528810d5b0 tx=0x7f526c009260 comp rx=0 tx=0).stop 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 msgr2=0x7f528810d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 0x7f528810d070 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f527400b710 tx=0x7f527400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 shutdown_connections 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f52600b5760 0x7f52600d5c10 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f528810a3b0 0x7f528810a850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5288115410 0x7f5288175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 --2- 10.20.193.90:0/440742488 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f528810f200 0x7f528810d070 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.797+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 >> 10.20.193.90:0/440742488 conn(0x7f52880ecac0 msgr2=0x7f52881109c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.798+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 shutdown_connections 2026-02-19T21:04:44.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.798+0000 7f528e2e86c0 1 -- 10.20.193.90:0/440742488 wait complete. 2026-02-19T21:04:44.803 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.802+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff35810be20 con 0x7ff358155780 2026-02-19T21:04:44.803 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.803+0000 7ff354ff96c0 1 -- 10.20.193.90:0/1776369788 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff34c0aa7c0 con 0x7ff358155780 2026-02-19T21:04:44.804 INFO:teuthology.orchestra.run.trial090.stdout:223338299404 2026-02-19T21:04:44.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.803+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdd7010fa00 con 0x7fdd7010f010 2026-02-19T21:04:44.804 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.803+0000 7fdd65ffb6c0 1 -- 10.20.193.90:0/3285836060 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdd600a9610 con 0x7fdd7010f010 2026-02-19T21:04:44.804 INFO:teuthology.orchestra.run.trial090.stdout:146028888080 2026-02-19T21:04:44.806 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018897 got 128849018897 for osd.4 2026-02-19T21:04:44.806 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff3300b5760 msgr2=0x7ff3300d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff3300b5760 0x7ff3300d5c10 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff344005b40 tx=0x7ff344009200 comp rx=0 tx=0).stop 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 msgr2=0x7ff358165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 0x7ff358165ee0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff34c006ea0 tx=0x7ff34c00cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 shutdown_connections 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff3300b5760 0x7ff3300d5c10 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff358155780 0x7ff358165ee0 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff35810c360 0x7ff358160b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 --2- 10.20.193.90:0/1776369788 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff35810ba50 0x7ff3581605e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 >> 10.20.193.90:0/1776369788 conn(0x7ff3580e96f0 msgr2=0x7ff358109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.807 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 shutdown_connections 2026-02-19T21:04:44.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7ff35e1296c0 1 -- 10.20.193.90:0/1776369788 wait complete. 2026-02-19T21:04:44.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdd4c0b5830 msgr2=0x7fdd4c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdd4c0b5830 0x7fdd4c0d5ce0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd70123910 tx=0x7fdd58005df0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 msgr2=0x7fdd7011cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 0x7fdd7011cf80 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd600092e0 tx=0x7fdd6000bc50 comp rx=0 tx=0).stop 2026-02-19T21:04:44.808 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 shutdown_connections 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdd4c0b5830 0x7fdd4c0d5ce0 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdd70122880 0x7fdd70122d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdd70115220 0x7fdd7011d4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 --2- 10.20.193.90:0/3285836060 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdd7010f010 0x7fdd7011cf80 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 >> 10.20.193.90:0/3285836060 conn(0x7fdd700ec890 msgr2=0x7fdd7010cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 shutdown_connections 2026-02-19T21:04:44.809 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.805+0000 7fdd76d086c0 1 -- 10.20.193.90:0/3285836060 wait complete. 2026-02-19T21:04:44.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.813+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6bc8113b30 con 0x7f6bc8126fd0 2026-02-19T21:04:44.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.813+0000 7f6bbdffb6c0 1 -- 10.20.193.90:0/956828935 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6bc4006ce0 con 0x7f6bc8126fd0 2026-02-19T21:04:44.814 INFO:teuthology.orchestra.run.trial090.stdout:68719476757 2026-02-19T21:04:44.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.815+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fcc20062940 con 0x7fcc20159a50 2026-02-19T21:04:44.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.815+0000 7fcbfffff6c0 1 -- 10.20.193.90:0/2480326753 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcc080cd930 con 0x7fcc20159a50 2026-02-19T21:04:44.816 INFO:teuthology.orchestra.run.trial090.stdout:253403070475 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6ba40b5760 msgr2=0x7f6ba40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6ba40b5760 0x7f6ba40d5c10 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bb8004750 tx=0x7f6bb8009390 comp rx=0 tx=0).stop 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 msgr2=0x7f6bc8127470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 0x7f6bc8127470 secure :-1 s=READY pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bc400a390 tx=0x7f6bc40054b0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 shutdown_connections 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6ba40b5760 0x7f6ba40d5c10 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6bc8126fd0 0x7f6bc8127470 unknown :-1 s=CLOSED pgs=295 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6bc81198b0 0x7f6bc8121c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 --2- 10.20.193.90:0/956828935 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6bc8113760 0x7f6bc81216d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 >> 10.20.193.90:0/956828935 conn(0x7f6bc8060720 msgr2=0x7f6bc8114e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 shutdown_connections 2026-02-19T21:04:44.817 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.816+0000 7f6bcf0846c0 1 -- 10.20.193.90:0/956828935 wait complete. 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf40b5760 msgr2=0x7fcbf40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf40b5760 0x7fcbf40d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc14004750 tx=0x7fcc14009260 comp rx=0 tx=0).stop 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 msgr2=0x7fcc20163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 0x7fcc20163870 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc08031fd0 tx=0x7fcc0802fc00 comp rx=0 tx=0).stop 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 shutdown_connections 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf40b5760 0x7fcbf40d5c10 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.819 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc20168c30 0x7fcc201690d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc20159a50 0x7fcc20163870 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 --2- 10.20.193.90:0/2480326753 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc20062f90 0x7fcc20163330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 >> 10.20.193.90:0/2480326753 conn(0x7fcc200ecac0 msgr2=0x7fcc2010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 shutdown_connections 2026-02-19T21:04:44.820 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.818+0000 7fcc252d36c0 1 -- 10.20.193.90:0/2480326753 wait complete. 2026-02-19T21:04:44.846 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:44 trial090 ceph-mon[31759]: Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2026-02-19T21:04:44.846 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1675077851' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-19T21:04:44.847 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3010870867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-19T21:04:44.847 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3139917406' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-19T21:04:44.847 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2525635047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-19T21:04:44.848 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607574 got 51539607574 for osd.1 2026-02-19T21:04:44.849 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.854+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f14880618a0 con 0x7f14880605a0 2026-02-19T21:04:44.855 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.854+0000 7f147dffb6c0 1 -- 10.20.193.90:0/1835007259 <== mon.2 v2:10.20.193.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f14840aa680 con 0x7f14880605a0 2026-02-19T21:04:44.856 INFO:teuthology.orchestra.run.trial090.stdout:176093659151 2026-02-19T21:04:44.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.855+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd43810d340 con 0x7fd43810cf70 2026-02-19T21:04:44.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.855+0000 7fd43c9066c0 1 -- 10.20.193.90:0/2102621420 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd42c0cd8c0 con 0x7fd43810cf70 2026-02-19T21:04:44.857 INFO:teuthology.orchestra.run.trial090.stdout:193273528333 2026-02-19T21:04:44.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.856+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0f2c0fa170 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.856+0000 7f0f28ff96c0 1 -- 10.20.193.90:0/3299133163 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0f200cea00 con 0x7f0f2c0f96a0 2026-02-19T21:04:44.858 INFO:teuthology.orchestra.run.trial090.stdout:270582939656 2026-02-19T21:04:44.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14640b58b0 msgr2=0x7f14640d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14640b58b0 0x7f14640d5d60 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1478004750 tx=0x7f1478009390 comp rx=0 tx=0).stop 2026-02-19T21:04:44.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 msgr2=0x7f1488060a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 0x7f1488060a40 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1484006ea0 tx=0x7f148400cca0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 shutdown_connections 2026-02-19T21:04:44.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14640b58b0 0x7f14640d5d60 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f14880605a0 0x7f1488060a40 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1488113180 0x7f1488173a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 --2- 10.20.193.90:0/1835007259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f148810cf70 0x7f1488062030 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 >> 10.20.193.90:0/1835007259 conn(0x7f14880ea870 msgr2=0x7f14881107b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 shutdown_connections 2026-02-19T21:04:44.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7f148f1506c0 1 -- 10.20.193.90:0/1835007259 wait complete. 2026-02-19T21:04:44.861 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299404 got 223338299404 for osd.8 2026-02-19T21:04:44.862 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd40c0b5760 msgr2=0x7fd40c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd40c0b5760 0x7fd40c0d5c10 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd4380fb550 tx=0x7fd4200092c0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 msgr2=0x7fd4380f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd4380f4bc0 secure :-1 s=READY pgs=301 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd42c02f230 tx=0x7fd42c02fc00 comp rx=0 tx=0).stop 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 shutdown_connections 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fd40c0b5760 0x7fd40c0d5c10 unknown :-1 s=CLOSED pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fd4380f51f0 0x7fd4380fa4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fd438113180 0x7fd438173a20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 --2- 10.20.193.90:0/2102621420 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fd43810cf70 0x7fd4380f4bc0 unknown :-1 s=CLOSED pgs=301 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.863 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.857+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 >> 10.20.193.90:0/2102621420 conn(0x7fd4380ea870 msgr2=0x7fd43810b490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.864 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.858+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 shutdown_connections 2026-02-19T21:04:44.864 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.858+0000 7fd43d9086c0 1 -- 10.20.193.90:0/2102621420 wait complete. 2026-02-19T21:04:44.864 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f000b57e0 msgr2=0x7f0f000d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f000b57e0 0x7f0f000d5c90 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f18004750 tx=0x7f0f18009260 comp rx=0 tx=0).stop 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 msgr2=0x7f0f2c0fe920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 0x7f0f2c0fe920 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f200027d0 tx=0x7f0f20005500 comp rx=0 tx=0).stop 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 shutdown_connections 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0f000b57e0 0x7f0f000d5c90 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0f2c0f96a0 0x7f0f2c0fe920 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0f2c115410 0x7f0f2c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 --2- 10.20.193.90:0/3299133163 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0f2c10f200 0x7f0f2c0f9070 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:44.865 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 >> 10.20.193.90:0/3299133163 conn(0x7f0f2c0ecac0 msgr2=0x7f0f2c110ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:44.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 shutdown_connections 2026-02-19T21:04:44.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:44.859+0000 7f0f31e0b6c0 1 -- 10.20.193.90:0/3299133163 wait complete. 2026-02-19T21:04:44.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070475 got 253403070475 for osd.9 2026-02-19T21:04:44.875 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.884 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476757 got 68719476757 for osd.2 2026-02-19T21:04:44.885 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.887 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888080 got 146028888080 for osd.5 2026-02-19T21:04:44.888 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.908 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939656 got 270582939656 for osd.10 2026-02-19T21:04:44.908 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.909 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659151 got 176093659151 for osd.6 2026-02-19T21:04:44.909 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528333 got 193273528333 for osd.7 2026-02-19T21:04:44.924 DEBUG:teuthology.parallel:result is None 2026-02-19T21:04:44.924 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-19T21:04:44.924 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-19T21:04:45.086 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:45.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:44 trial105 ceph-mon[33883]: Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2026-02-19T21:04:45.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1675077851' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-19T21:04:45.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3010870867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-19T21:04:45.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3139917406' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-19T21:04:45.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2525635047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-19T21:04:45.202 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/681709220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410fbf0 msgr2=0x7fe7c4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/681709220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410fbf0 0x7fe7c4114c30 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=13233865932645809361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7b80099a0 tx=0x7fe7b802ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/681709220 shutdown_connections 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/681709220 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe7c4115410 0x7fe7c4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/681709220 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410fbf0 0x7fe7c4114c30 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=13233865932645809361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/681709220 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe7c410f200 0x7fe7c410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/681709220 >> 10.20.193.90:0/681709220 conn(0x7fe7c40ecac0 msgr2=0x7fe7c410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/681709220 shutdown_connections 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.199+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/681709220 wait complete. 2026-02-19T21:04:45.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 Processor -- start 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 -- start start 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 0x7fe7c40f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe7c4115410 0x7fe7c4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe7c40f51f0 0x7fe7c40fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c40f58e0 con 0x7fe7c410f200 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c40faa00 con 0x7fe7c4115410 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c40fabc0 con 0x7fe7c40f51f0 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 0x7fe7c40f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 0x7fe7c40f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43222/0 (socket says 10.20.193.90:43222) 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 -- 10.20.193.90:0/3242198333 learned_addr learned my addr 10.20.193.90:0/3242198333 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7c9bbf6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe7c4115410 0x7fe7c4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.204 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cabc16c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe7c40f51f0 0x7fe7c40fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 -- 10.20.193.90:0/3242198333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe7c40f51f0 msgr2=0x7fe7c40fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe7c40f51f0 0x7fe7c40fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 -- 10.20.193.90:0/3242198333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe7c4115410 msgr2=0x7fe7c4175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe7c4115410 0x7fe7c4175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 -- 10.20.193.90:0/3242198333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b8009590 con 0x7fe7c410f200 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ca3c06c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 0x7fe7c40f4bc0 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7b40092e0 tx=0x7fe7b400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7b4004250 con 0x7fe7c410f200 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe7b40043b0 con 0x7fe7c410f200 2026-02-19T21:04:45.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe7b400cd70 con 0x7fe7c410f200 2026-02-19T21:04:45.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c40faea0 con 0x7fe7c410f200 2026-02-19T21:04:45.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.200+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c40fb330 con 0x7fe7c410f200 2026-02-19T21:04:45.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.201+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c41104d0 con 0x7fe7c410f200 2026-02-19T21:04:45.207 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.202+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fe7b40026b0 con 0x7fe7c410f200 2026-02-19T21:04:45.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.202+0000 7fe7ab7fe6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe7a00b5760 0x7fe7a00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.203+0000 7fe7c9bbf6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe7a00b5760 0x7fe7a00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.203+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fe7b40e3a00 con 0x7fe7c410f200 2026-02-19T21:04:45.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.203+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe7b40a6250 con 0x7fe7c410f200 2026-02-19T21:04:45.208 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.203+0000 7fe7c9bbf6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe7a00b5760 0x7fe7a00d5c10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7c40fb550 tx=0x7fe7b80023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:45.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:44 trial175 ceph-mon[34116]: Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2026-02-19T21:04:45.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1675077851' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-19T21:04:45.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3010870867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-19T21:04:45.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3139917406' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-19T21:04:45.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2525635047' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-19T21:04:45.292 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.291+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7c40fb330 con 0x7fe7a00b5760 2026-02-19T21:04:45.294 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.293+0000 7fe7ab7fe6c0 1 -- 10.20.193.90:0/3242198333 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258838 (secure 0 0 0) 0x7fe7c40fb330 con 0x7fe7a00b5760 2026-02-19T21:04:45.297 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:45.299 INFO:teuthology.orchestra.run.trial090.stderr:dumped all 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe7a00b5760 msgr2=0x7fe7a00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe7a00b5760 0x7fe7a00d5c10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7c40fb550 tx=0x7fe7b80023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 msgr2=0x7fe7c40f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 0x7fe7c40f4bc0 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe7b40092e0 tx=0x7fe7b400bc50 comp rx=0 tx=0).stop 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 shutdown_connections 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe7a00b5760 0x7fe7a00d5c10 unknown :-1 s=CLOSED pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.301 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe7c40f51f0 0x7fe7c40fa4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.302 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe7c4115410 0x7fe7c4175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.302 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 --2- 10.20.193.90:0/3242198333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe7c410f200 0x7fe7c40f4bc0 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.302 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 >> 10.20.193.90:0/3242198333 conn(0x7fe7c40ecac0 msgr2=0x7fe7c410d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:45.302 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 shutdown_connections 2026-02-19T21:04:45.302 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.295+0000 7fe7cc64f6c0 1 -- 10.20.193.90:0/3242198333 wait complete. 2026-02-19T21:04:45.333 INFO:teuthology.orchestra.run.trial090.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2026-02-19T21:04:44.880159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647532,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":179,"num_read_kb":187,"num_write":337,"num_write_kb":3822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1233580,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335484,"kb_used_data":11856,"kb_used_omap":391,"kb_used_meta":322936,"kb_avail":8807702916,"statfs":{"total":9019431321600,"available":9019087785984,"internally_reserved":0,"allocated":12140544,"data_stored":6820309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":400768,"internal_metadata":330687104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53484,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":65,"num_read_kb":88,"num_write":79,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":52844,"num_keys_recovered":11,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001841"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777336+0000","last_change":"2026-02-19T21:04:31.287002+0000","last_active":"2026-02-19T21:04:42.777336+0000","last_peered":"2026-02-19T21:04:42.777336+0000","last_clean":"2026-02-19T21:04:42.777336+0000","last_became_active":"2026-02-19T21:04:31.286342+0000","last_became_peered":"2026-02-19T21:04:31.286342+0000","last_unstale":"2026-02-19T21:04:42.777336+0000","last_undegraded":"2026-02-19T21:04:42.777336+0000","last_fullsized":"2026-02-19T21:04:42.777336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:10:00.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773812+0000","last_change":"2026-02-19T21:04:31.285136+0000","last_active":"2026-02-19T21:04:41.773812+0000","last_peered":"2026-02-19T21:04:41.773812+0000","last_clean":"2026-02-19T21:04:41.773812+0000","last_became_active":"2026-02-19T21:04:31.284945+0000","last_became_peered":"2026-02-19T21:04:31.284945+0000","last_unstale":"2026-02-19T21:04:41.773812+0000","last_undegraded":"2026-02-19T21:04:41.773812+0000","last_fullsized":"2026-02-19T21:04:41.773812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:08:07.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773704+0000","last_change":"2026-02-19T21:04:31.286791+0000","last_active":"2026-02-19T21:04:41.773704+0000","last_peered":"2026-02-19T21:04:41.773704+0000","last_clean":"2026-02-19T21:04:41.773704+0000","last_became_active":"2026-02-19T21:04:31.286150+0000","last_became_peered":"2026-02-19T21:04:31.286150+0000","last_unstale":"2026-02-19T21:04:41.773704+0000","last_undegraded":"2026-02-19T21:04:41.773704+0000","last_fullsized":"2026-02-19T21:04:41.773704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:29:44.208057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775649+0000","last_change":"2026-02-19T21:04:31.287914+0000","last_active":"2026-02-19T21:04:42.775649+0000","last_peered":"2026-02-19T21:04:42.775649+0000","last_clean":"2026-02-19T21:04:42.775649+0000","last_became_active":"2026-02-19T21:04:31.287376+0000","last_became_peered":"2026-02-19T21:04:31.287376+0000","last_unstale":"2026-02-19T21:04:42.775649+0000","last_undegraded":"2026-02-19T21:04:42.775649+0000","last_fullsized":"2026-02-19T21:04:42.775649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:27:40.549645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776061+0000","last_change":"2026-02-19T21:04:31.286299+0000","last_active":"2026-02-19T21:04:42.776061+0000","last_peered":"2026-02-19T21:04:42.776061+0000","last_clean":"2026-02-19T21:04:42.776061+0000","last_became_active":"2026-02-19T21:04:31.285600+0000","last_became_peered":"2026-02-19T21:04:31.285600+0000","last_unstale":"2026-02-19T21:04:42.776061+0000","last_undegraded":"2026-02-19T21:04:42.776061+0000","last_fullsized":"2026-02-19T21:04:42.776061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:26:00.465870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775549+0000","last_change":"2026-02-19T21:04:31.285609+0000","last_active":"2026-02-19T21:04:42.775549+0000","last_peered":"2026-02-19T21:04:42.775549+0000","last_clean":"2026-02-19T21:04:42.775549+0000","last_became_active":"2026-02-19T21:04:31.285465+0000","last_became_peered":"2026-02-19T21:04:31.285465+0000","last_unstale":"2026-02-19T21:04:42.775549+0000","last_undegraded":"2026-02-19T21:04:42.775549+0000","last_fullsized":"2026-02-19T21:04:42.775549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:10.356903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773710+0000","last_change":"2026-02-19T21:04:31.287193+0000","last_active":"2026-02-19T21:04:41.773710+0000","last_peered":"2026-02-19T21:04:41.773710+0000","last_clean":"2026-02-19T21:04:41.773710+0000","last_became_active":"2026-02-19T21:04:31.286850+0000","last_became_peered":"2026-02-19T21:04:31.286850+0000","last_unstale":"2026-02-19T21:04:41.773710+0000","last_undegraded":"2026-02-19T21:04:41.773710+0000","last_fullsized":"2026-02-19T21:04:41.773710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:50.866916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.779068+0000","last_change":"2026-02-19T21:04:42.778626+0000","last_active":"2026-02-19T21:04:42.779068+0000","last_peered":"2026-02-19T21:04:42.779068+0000","last_clean":"2026-02-19T21:04:42.779068+0000","last_became_active":"2026-02-19T21:04:42.778275+0000","last_became_peered":"2026-02-19T21:04:42.778275+0000","last_unstale":"2026-02-19T21:04:42.779068+0000","last_undegraded":"2026-02-19T21:04:42.779068+0000","last_fullsized":"2026-02-19T21:04:42.779068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:39.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776842+0000","last_change":"2026-02-19T21:04:31.288496+0000","last_active":"2026-02-19T21:04:42.776842+0000","last_peered":"2026-02-19T21:04:42.776842+0000","last_clean":"2026-02-19T21:04:42.776842+0000","last_became_active":"2026-02-19T21:04:31.288194+0000","last_became_peered":"2026-02-19T21:04:31.288194+0000","last_unstale":"2026-02-19T21:04:42.776842+0000","last_undegraded":"2026-02-19T21:04:42.776842+0000","last_fullsized":"2026-02-19T21:04:42.776842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:00:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775739+0000","last_change":"2026-02-19T21:04:31.288303+0000","last_active":"2026-02-19T21:04:42.775739+0000","last_peered":"2026-02-19T21:04:42.775739+0000","last_clean":"2026-02-19T21:04:42.775739+0000","last_became_active":"2026-02-19T21:04:31.288160+0000","last_became_peered":"2026-02-19T21:04:31.288160+0000","last_unstale":"2026-02-19T21:04:42.775739+0000","last_undegraded":"2026-02-19T21:04:42.775739+0000","last_fullsized":"2026-02-19T21:04:42.775739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:47:29.467905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773970+0000","last_change":"2026-02-19T21:04:31.287633+0000","last_active":"2026-02-19T21:04:41.773970+0000","last_peered":"2026-02-19T21:04:41.773970+0000","last_clean":"2026-02-19T21:04:41.773970+0000","last_became_active":"2026-02-19T21:04:31.287434+0000","last_became_peered":"2026-02-19T21:04:31.287434+0000","last_unstale":"2026-02-19T21:04:41.773970+0000","last_undegraded":"2026-02-19T21:04:41.773970+0000","last_fullsized":"2026-02-19T21:04:41.773970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:34:20.533516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775709+0000","last_change":"2026-02-19T21:04:31.288404+0000","last_active":"2026-02-19T21:04:42.775709+0000","last_peered":"2026-02-19T21:04:42.775709+0000","last_clean":"2026-02-19T21:04:42.775709+0000","last_became_active":"2026-02-19T21:04:31.287620+0000","last_became_peered":"2026-02-19T21:04:31.287620+0000","last_unstale":"2026-02-19T21:04:42.775709+0000","last_undegraded":"2026-02-19T21:04:42.775709+0000","last_fullsized":"2026-02-19T21:04:42.775709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:25.760231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775177+0000","last_change":"2026-02-19T21:04:31.285595+0000","last_active":"2026-02-19T21:04:42.775177+0000","last_peered":"2026-02-19T21:04:42.775177+0000","last_clean":"2026-02-19T21:04:42.775177+0000","last_became_active":"2026-02-19T21:04:31.285372+0000","last_became_peered":"2026-02-19T21:04:31.285372+0000","last_unstale":"2026-02-19T21:04:42.775177+0000","last_undegraded":"2026-02-19T21:04:42.775177+0000","last_fullsized":"2026-02-19T21:04:42.775177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:35.546455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773611+0000","last_change":"2026-02-19T21:04:31.284499+0000","last_active":"2026-02-19T21:04:41.773611+0000","last_peered":"2026-02-19T21:04:41.773611+0000","last_clean":"2026-02-19T21:04:41.773611+0000","last_became_active":"2026-02-19T21:04:31.284262+0000","last_became_peered":"2026-02-19T21:04:31.284262+0000","last_unstale":"2026-02-19T21:04:41.773611+0000","last_undegraded":"2026-02-19T21:04:41.773611+0000","last_fullsized":"2026-02-19T21:04:41.773611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:48:14.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773585+0000","last_change":"2026-02-19T21:04:31.287280+0000","last_active":"2026-02-19T21:04:41.773585+0000","last_peered":"2026-02-19T21:04:41.773585+0000","last_clean":"2026-02-19T21:04:41.773585+0000","last_became_active":"2026-02-19T21:04:31.287026+0000","last_became_peered":"2026-02-19T21:04:31.287026+0000","last_unstale":"2026-02-19T21:04:41.773585+0000","last_undegraded":"2026-02-19T21:04:41.773585+0000","last_fullsized":"2026-02-19T21:04:41.773585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:15:11.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776564+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:42.776564+0000","last_peered":"2026-02-19T21:04:42.776564+0000","last_clean":"2026-02-19T21:04:42.776564+0000","last_became_active":"2026-02-19T21:04:31.286591+0000","last_became_peered":"2026-02-19T21:04:31.286591+0000","last_unstale":"2026-02-19T21:04:42.776564+0000","last_undegraded":"2026-02-19T21:04:42.776564+0000","last_fullsized":"2026-02-19T21:04:42.776564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:24:52.717294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777489+0000","last_change":"2026-02-19T21:04:31.287192+0000","last_active":"2026-02-19T21:04:42.777489+0000","last_peered":"2026-02-19T21:04:42.777489+0000","last_clean":"2026-02-19T21:04:42.777489+0000","last_became_active":"2026-02-19T21:04:31.287005+0000","last_became_peered":"2026-02-19T21:04:31.287005+0000","last_unstale":"2026-02-19T21:04:42.777489+0000","last_undegraded":"2026-02-19T21:04:42.777489+0000","last_fullsized":"2026-02-19T21:04:42.777489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:18.523767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775384+0000","last_change":"2026-02-19T21:04:31.285298+0000","last_active":"2026-02-19T21:04:42.775384+0000","last_peered":"2026-02-19T21:04:42.775384+0000","last_clean":"2026-02-19T21:04:42.775384+0000","last_became_active":"2026-02-19T21:04:31.285047+0000","last_became_peered":"2026-02-19T21:04:31.285047+0000","last_unstale":"2026-02-19T21:04:42.775384+0000","last_undegraded":"2026-02-19T21:04:42.775384+0000","last_fullsized":"2026-02-19T21:04:42.775384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:32:45.124589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777490+0000","last_change":"2026-02-19T21:04:31.287399+0000","last_active":"2026-02-19T21:04:42.777490+0000","last_peered":"2026-02-19T21:04:42.777490+0000","last_clean":"2026-02-19T21:04:42.777490+0000","last_became_active":"2026-02-19T21:04:31.286835+0000","last_became_peered":"2026-02-19T21:04:31.286835+0000","last_unstale":"2026-02-19T21:04:42.777490+0000","last_undegraded":"2026-02-19T21:04:42.777490+0000","last_fullsized":"2026-02-19T21:04:42.777490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:16.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777661+0000","last_change":"2026-02-19T21:04:31.288156+0000","last_active":"2026-02-19T21:04:42.777661+0000","last_peered":"2026-02-19T21:04:42.777661+0000","last_clean":"2026-02-19T21:04:42.777661+0000","last_became_active":"2026-02-19T21:04:31.288012+0000","last_became_peered":"2026-02-19T21:04:31.288012+0000","last_unstale":"2026-02-19T21:04:42.777661+0000","last_undegraded":"2026-02-19T21:04:42.777661+0000","last_fullsized":"2026-02-19T21:04:42.777661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:05:48.712920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775209+0000","last_change":"2026-02-19T21:04:31.285690+0000","last_active":"2026-02-19T21:04:42.775209+0000","last_peered":"2026-02-19T21:04:42.775209+0000","last_clean":"2026-02-19T21:04:42.775209+0000","last_became_active":"2026-02-19T21:04:31.285498+0000","last_became_peered":"2026-02-19T21:04:31.285498+0000","last_unstale":"2026-02-19T21:04:42.775209+0000","last_undegraded":"2026-02-19T21:04:42.775209+0000","last_fullsized":"2026-02-19T21:04:42.775209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:48:40.789834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776595+0000","last_change":"2026-02-19T21:04:31.288360+0000","last_active":"2026-02-19T21:04:42.776595+0000","last_peered":"2026-02-19T21:04:42.776595+0000","last_clean":"2026-02-19T21:04:42.776595+0000","last_became_active":"2026-02-19T21:04:31.287849+0000","last_became_peered":"2026-02-19T21:04:31.287849+0000","last_unstale":"2026-02-19T21:04:42.776595+0000","last_undegraded":"2026-02-19T21:04:42.776595+0000","last_fullsized":"2026-02-19T21:04:42.776595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:24:06.399904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777191+0000","last_change":"2026-02-19T21:04:31.286420+0000","last_active":"2026-02-19T21:04:42.777191+0000","last_peered":"2026-02-19T21:04:42.777191+0000","last_clean":"2026-02-19T21:04:42.777191+0000","last_became_active":"2026-02-19T21:04:31.285905+0000","last_became_peered":"2026-02-19T21:04:31.285905+0000","last_unstale":"2026-02-19T21:04:42.777191+0000","last_undegraded":"2026-02-19T21:04:42.777191+0000","last_fullsized":"2026-02-19T21:04:42.777191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:07:02.537538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778771+0000","last_change":"2026-02-19T21:04:31.288706+0000","last_active":"2026-02-19T21:04:42.778771+0000","last_peered":"2026-02-19T21:04:42.778771+0000","last_clean":"2026-02-19T21:04:42.778771+0000","last_became_active":"2026-02-19T21:04:31.287837+0000","last_became_peered":"2026-02-19T21:04:31.287837+0000","last_unstale":"2026-02-19T21:04:42.778771+0000","last_undegraded":"2026-02-19T21:04:42.778771+0000","last_fullsized":"2026-02-19T21:04:42.778771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:33:01.082715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777972+0000","last_change":"2026-02-19T21:04:31.286807+0000","last_active":"2026-02-19T21:04:42.777972+0000","last_peered":"2026-02-19T21:04:42.777972+0000","last_clean":"2026-02-19T21:04:42.777972+0000","last_became_active":"2026-02-19T21:04:31.286555+0000","last_became_peered":"2026-02-19T21:04:31.286555+0000","last_unstale":"2026-02-19T21:04:42.777972+0000","last_undegraded":"2026-02-19T21:04:42.777972+0000","last_fullsized":"2026-02-19T21:04:42.777972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:33.064392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777589+0000","last_change":"2026-02-19T21:04:31.288135+0000","last_active":"2026-02-19T21:04:42.777589+0000","last_peered":"2026-02-19T21:04:42.777589+0000","last_clean":"2026-02-19T21:04:42.777589+0000","last_became_active":"2026-02-19T21:04:31.287889+0000","last_became_peered":"2026-02-19T21:04:31.287889+0000","last_unstale":"2026-02-19T21:04:42.777589+0000","last_undegraded":"2026-02-19T21:04:42.777589+0000","last_fullsized":"2026-02-19T21:04:42.777589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:41:33.753704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777191+0000","last_change":"2026-02-19T21:04:31.286954+0000","last_active":"2026-02-19T21:04:42.777191+0000","last_peered":"2026-02-19T21:04:42.777191+0000","last_clean":"2026-02-19T21:04:42.777191+0000","last_became_active":"2026-02-19T21:04:31.286509+0000","last_became_peered":"2026-02-19T21:04:31.286509+0000","last_unstale":"2026-02-19T21:04:42.777191+0000","last_undegraded":"2026-02-19T21:04:42.777191+0000","last_fullsized":"2026-02-19T21:04:42.777191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:03.051404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775190+0000","last_change":"2026-02-19T21:04:31.288452+0000","last_active":"2026-02-19T21:04:42.775190+0000","last_peered":"2026-02-19T21:04:42.775190+0000","last_clean":"2026-02-19T21:04:42.775190+0000","last_became_active":"2026-02-19T21:04:31.288288+0000","last_became_peered":"2026-02-19T21:04:31.288288+0000","last_unstale":"2026-02-19T21:04:42.775190+0000","last_undegraded":"2026-02-19T21:04:42.775190+0000","last_fullsized":"2026-02-19T21:04:42.775190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:36:20.116850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773786+0000","last_change":"2026-02-19T21:04:31.287437+0000","last_active":"2026-02-19T21:04:41.773786+0000","last_peered":"2026-02-19T21:04:41.773786+0000","last_clean":"2026-02-19T21:04:41.773786+0000","last_became_active":"2026-02-19T21:04:31.287292+0000","last_became_peered":"2026-02-19T21:04:31.287292+0000","last_unstale":"2026-02-19T21:04:41.773786+0000","last_undegraded":"2026-02-19T21:04:41.773786+0000","last_fullsized":"2026-02-19T21:04:41.773786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:27.235359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777328+0000","last_change":"2026-02-19T21:04:31.286030+0000","last_active":"2026-02-19T21:04:42.777328+0000","last_peered":"2026-02-19T21:04:42.777328+0000","last_clean":"2026-02-19T21:04:42.777328+0000","last_became_active":"2026-02-19T21:04:31.285556+0000","last_became_peered":"2026-02-19T21:04:31.285556+0000","last_unstale":"2026-02-19T21:04:42.777328+0000","last_undegraded":"2026-02-19T21:04:42.777328+0000","last_fullsized":"2026-02-19T21:04:42.777328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:09:01.348835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777502+0000","last_change":"2026-02-19T21:04:31.289211+0000","last_active":"2026-02-19T21:04:42.777502+0000","last_peered":"2026-02-19T21:04:42.777502+0000","last_clean":"2026-02-19T21:04:42.777502+0000","last_became_active":"2026-02-19T21:04:31.288961+0000","last_became_peered":"2026-02-19T21:04:31.288961+0000","last_unstale":"2026-02-19T21:04:42.777502+0000","last_undegraded":"2026-02-19T21:04:42.777502+0000","last_fullsized":"2026-02-19T21:04:42.777502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:03:11.179940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777063+0000","last_change":"2026-02-19T21:04:31.288628+0000","last_active":"2026-02-19T21:04:42.777063+0000","last_peered":"2026-02-19T21:04:42.777063+0000","last_clean":"2026-02-19T21:04:42.777063+0000","last_became_active":"2026-02-19T21:04:31.288458+0000","last_became_peered":"2026-02-19T21:04:31.288458+0000","last_unstale":"2026-02-19T21:04:42.777063+0000","last_undegraded":"2026-02-19T21:04:42.777063+0000","last_fullsized":"2026-02-19T21:04:42.777063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:24:59.338008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776112+0000","last_change":"2026-02-19T21:04:31.287078+0000","last_active":"2026-02-19T21:04:42.776112+0000","last_peered":"2026-02-19T21:04:42.776112+0000","last_clean":"2026-02-19T21:04:42.776112+0000","last_became_active":"2026-02-19T21:04:31.286730+0000","last_became_peered":"2026-02-19T21:04:31.286730+0000","last_unstale":"2026-02-19T21:04:42.776112+0000","last_undegraded":"2026-02-19T21:04:42.776112+0000","last_fullsized":"2026-02-19T21:04:42.776112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:52:57.154998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778761+0000","last_change":"2026-02-19T21:04:30.410537+0000","last_active":"2026-02-19T21:04:42.778761+0000","last_peered":"2026-02-19T21:04:42.778761+0000","last_clean":"2026-02-19T21:04:42.778761+0000","last_became_active":"2026-02-19T21:04:30.410253+0000","last_became_peered":"2026-02-19T21:04:30.410253+0000","last_unstale":"2026-02-19T21:04:42.778761+0000","last_undegraded":"2026-02-19T21:04:42.778761+0000","last_fullsized":"2026-02-19T21:04:42.778761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:43:09.872775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.779367+0000","last_change":"2026-02-19T21:04:42.778950+0000","last_active":"2026-02-19T21:04:42.779367+0000","last_peered":"2026-02-19T21:04:42.779367+0000","last_clean":"2026-02-19T21:04:42.779367+0000","last_became_active":"2026-02-19T21:04:42.778721+0000","last_became_peered":"2026-02-19T21:04:42.778721+0000","last_unstale":"2026-02-19T21:04:42.779367+0000","last_undegraded":"2026-02-19T21:04:42.779367+0000","last_fullsized":"2026-02-19T21:04:42.779367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:35:19.647044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775514+0000","last_change":"2026-02-19T21:04:30.411183+0000","last_active":"2026-02-19T21:04:42.775514+0000","last_peered":"2026-02-19T21:04:42.775514+0000","last_clean":"2026-02-19T21:04:42.775514+0000","last_became_active":"2026-02-19T21:04:30.410927+0000","last_became_peered":"2026-02-19T21:04:30.410927+0000","last_unstale":"2026-02-19T21:04:42.775514+0000","last_undegraded":"2026-02-19T21:04:42.775514+0000","last_fullsized":"2026-02-19T21:04:42.775514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:27:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775028+0000","last_change":"2026-02-19T21:04:30.407656+0000","last_active":"2026-02-19T21:04:42.775028+0000","last_peered":"2026-02-19T21:04:42.775028+0000","last_clean":"2026-02-19T21:04:42.775028+0000","last_became_active":"2026-02-19T21:04:30.407355+0000","last_became_peered":"2026-02-19T21:04:30.407355+0000","last_unstale":"2026-02-19T21:04:42.775028+0000","last_undegraded":"2026-02-19T21:04:42.775028+0000","last_fullsized":"2026-02-19T21:04:42.775028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:45:24.893068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777237+0000","last_change":"2026-02-19T21:04:31.282577+0000","last_active":"2026-02-19T21:04:42.777237+0000","last_peered":"2026-02-19T21:04:42.777237+0000","last_clean":"2026-02-19T21:04:42.777237+0000","last_became_active":"2026-02-19T21:04:31.282337+0000","last_became_peered":"2026-02-19T21:04:31.282337+0000","last_unstale":"2026-02-19T21:04:42.777237+0000","last_undegraded":"2026-02-19T21:04:42.777237+0000","last_fullsized":"2026-02-19T21:04:42.777237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:16:10.971557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778995+0000","last_change":"2026-02-19T21:04:30.409768+0000","last_active":"2026-02-19T21:04:42.778995+0000","last_peered":"2026-02-19T21:04:42.778995+0000","last_clean":"2026-02-19T21:04:42.778995+0000","last_became_active":"2026-02-19T21:04:30.409536+0000","last_became_peered":"2026-02-19T21:04:30.409536+0000","last_unstale":"2026-02-19T21:04:42.778995+0000","last_undegraded":"2026-02-19T21:04:42.778995+0000","last_fullsized":"2026-02-19T21:04:42.778995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:59.805182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.774967+0000","last_change":"2026-02-19T21:04:31.284256+0000","last_active":"2026-02-19T21:04:42.774967+0000","last_peered":"2026-02-19T21:04:42.774967+0000","last_clean":"2026-02-19T21:04:42.774967+0000","last_became_active":"2026-02-19T21:04:31.284072+0000","last_became_peered":"2026-02-19T21:04:31.284072+0000","last_unstale":"2026-02-19T21:04:42.774967+0000","last_undegraded":"2026-02-19T21:04:42.774967+0000","last_fullsized":"2026-02-19T21:04:42.774967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:06:45.684098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775706+0000","last_change":"2026-02-19T21:04:30.411605+0000","last_active":"2026-02-19T21:04:42.775706+0000","last_peered":"2026-02-19T21:04:42.775706+0000","last_clean":"2026-02-19T21:04:42.775706+0000","last_became_active":"2026-02-19T21:04:30.411457+0000","last_became_peered":"2026-02-19T21:04:30.411457+0000","last_unstale":"2026-02-19T21:04:42.775706+0000","last_undegraded":"2026-02-19T21:04:42.775706+0000","last_fullsized":"2026-02-19T21:04:42.775706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:03:03.301109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776855+0000","last_change":"2026-02-19T21:04:31.286695+0000","last_active":"2026-02-19T21:04:42.776855+0000","last_peered":"2026-02-19T21:04:42.776855+0000","last_clean":"2026-02-19T21:04:42.776855+0000","last_became_active":"2026-02-19T21:04:31.286522+0000","last_became_peered":"2026-02-19T21:04:31.286522+0000","last_unstale":"2026-02-19T21:04:42.776855+0000","last_undegraded":"2026-02-19T21:04:42.776855+0000","last_fullsized":"2026-02-19T21:04:42.776855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:49:26.698378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773944+0000","last_change":"2026-02-19T21:04:30.409642+0000","last_active":"2026-02-19T21:04:41.773944+0000","last_peered":"2026-02-19T21:04:41.773944+0000","last_clean":"2026-02-19T21:04:41.773944+0000","last_became_active":"2026-02-19T21:04:30.409369+0000","last_became_peered":"2026-02-19T21:04:30.409369+0000","last_unstale":"2026-02-19T21:04:41.773944+0000","last_undegraded":"2026-02-19T21:04:41.773944+0000","last_fullsized":"2026-02-19T21:04:41.773944+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:42:09.905781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773901+0000","last_change":"2026-02-19T21:04:31.287134+0000","last_active":"2026-02-19T21:04:41.773901+0000","last_peered":"2026-02-19T21:04:41.773901+0000","last_clean":"2026-02-19T21:04:41.773901+0000","last_became_active":"2026-02-19T21:04:31.286957+0000","last_became_peered":"2026-02-19T21:04:31.286957+0000","last_unstale":"2026-02-19T21:04:41.773901+0000","last_undegraded":"2026-02-19T21:04:41.773901+0000","last_fullsized":"2026-02-19T21:04:41.773901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:20:14.188668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778710+0000","last_change":"2026-02-19T21:04:30.410806+0000","last_active":"2026-02-19T21:04:42.778710+0000","last_peered":"2026-02-19T21:04:42.778710+0000","last_clean":"2026-02-19T21:04:42.778710+0000","last_became_active":"2026-02-19T21:04:30.410547+0000","last_became_peered":"2026-02-19T21:04:30.410547+0000","last_unstale":"2026-02-19T21:04:42.778710+0000","last_undegraded":"2026-02-19T21:04:42.778710+0000","last_fullsized":"2026-02-19T21:04:42.778710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:43:04.471874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776899+0000","last_change":"2026-02-19T21:04:31.288726+0000","last_active":"2026-02-19T21:04:42.776899+0000","last_peered":"2026-02-19T21:04:42.776899+0000","last_clean":"2026-02-19T21:04:42.776899+0000","last_became_active":"2026-02-19T21:04:31.288355+0000","last_became_peered":"2026-02-19T21:04:31.288355+0000","last_unstale":"2026-02-19T21:04:42.776899+0000","last_undegraded":"2026-02-19T21:04:42.776899+0000","last_fullsized":"2026-02-19T21:04:42.776899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:23:35.206511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'22","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.780127+0000","last_change":"2026-02-19T21:04:42.780085+0000","last_active":"2026-02-19T21:04:42.780127+0000","last_peered":"2026-02-19T21:04:42.780127+0000","last_clean":"2026-02-19T21:04:42.780127+0000","last_became_active":"2026-02-19T21:04:42.777091+0000","last_became_peered":"2026-02-19T21:04:42.777091+0000","last_unstale":"2026-02-19T21:04:42.780127+0000","last_undegraded":"2026-02-19T21:04:42.780127+0000","last_fullsized":"2026-02-19T21:04:42.780127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:30:11.483105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":54,"num_write":23,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":52844,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776167+0000","last_change":"2026-02-19T21:04:31.287063+0000","last_active":"2026-02-19T21:04:42.776167+0000","last_peered":"2026-02-19T21:04:42.776167+0000","last_clean":"2026-02-19T21:04:42.776167+0000","last_became_active":"2026-02-19T21:04:31.286765+0000","last_became_peered":"2026-02-19T21:04:31.286765+0000","last_unstale":"2026-02-19T21:04:42.776167+0000","last_undegraded":"2026-02-19T21:04:42.776167+0000","last_fullsized":"2026-02-19T21:04:42.776167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:15:56.935874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777541+0000","last_change":"2026-02-19T21:04:30.411559+0000","last_active":"2026-02-19T21:04:42.777541+0000","last_peered":"2026-02-19T21:04:42.777541+0000","last_clean":"2026-02-19T21:04:42.777541+0000","last_became_active":"2026-02-19T21:04:30.411317+0000","last_became_peered":"2026-02-19T21:04:30.411317+0000","last_unstale":"2026-02-19T21:04:42.777541+0000","last_undegraded":"2026-02-19T21:04:42.777541+0000","last_fullsized":"2026-02-19T21:04:42.777541+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:55.609906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775197+0000","last_change":"2026-02-19T21:04:31.286692+0000","last_active":"2026-02-19T21:04:42.775197+0000","last_peered":"2026-02-19T21:04:42.775197+0000","last_clean":"2026-02-19T21:04:42.775197+0000","last_became_active":"2026-02-19T21:04:31.286343+0000","last_became_peered":"2026-02-19T21:04:31.286343+0000","last_unstale":"2026-02-19T21:04:42.775197+0000","last_undegraded":"2026-02-19T21:04:42.775197+0000","last_fullsized":"2026-02-19T21:04:42.775197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:34:53.155015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778551+0000","last_change":"2026-02-19T21:04:30.409868+0000","last_active":"2026-02-19T21:04:42.778551+0000","last_peered":"2026-02-19T21:04:42.778551+0000","last_clean":"2026-02-19T21:04:42.778551+0000","last_became_active":"2026-02-19T21:04:30.409568+0000","last_became_peered":"2026-02-19T21:04:30.409568+0000","last_unstale":"2026-02-19T21:04:42.778551+0000","last_undegraded":"2026-02-19T21:04:42.778551+0000","last_fullsized":"2026-02-19T21:04:42.778551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:45:25.596378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773925+0000","last_change":"2026-02-19T21:04:31.288696+0000","last_active":"2026-02-19T21:04:41.773925+0000","last_peered":"2026-02-19T21:04:41.773925+0000","last_clean":"2026-02-19T21:04:41.773925+0000","last_became_active":"2026-02-19T21:04:31.288460+0000","last_became_peered":"2026-02-19T21:04:31.288460+0000","last_unstale":"2026-02-19T21:04:41.773925+0000","last_undegraded":"2026-02-19T21:04:41.773925+0000","last_fullsized":"2026-02-19T21:04:41.773925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:02.502851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775567+0000","last_change":"2026-02-19T21:04:30.409894+0000","last_active":"2026-02-19T21:04:42.775567+0000","last_peered":"2026-02-19T21:04:42.775567+0000","last_clean":"2026-02-19T21:04:42.775567+0000","last_became_active":"2026-02-19T21:04:30.409694+0000","last_became_peered":"2026-02-19T21:04:30.409694+0000","last_unstale":"2026-02-19T21:04:42.775567+0000","last_undegraded":"2026-02-19T21:04:42.775567+0000","last_fullsized":"2026-02-19T21:04:42.775567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:44:08.909989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773691+0000","last_change":"2026-02-19T21:04:31.289106+0000","last_active":"2026-02-19T21:04:41.773691+0000","last_peered":"2026-02-19T21:04:41.773691+0000","last_clean":"2026-02-19T21:04:41.773691+0000","last_became_active":"2026-02-19T21:04:31.288889+0000","last_became_peered":"2026-02-19T21:04:31.288889+0000","last_unstale":"2026-02-19T21:04:41.773691+0000","last_undegraded":"2026-02-19T21:04:41.773691+0000","last_fullsized":"2026-02-19T21:04:41.773691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:56:11.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776003+0000","last_change":"2026-02-19T21:04:30.409277+0000","last_active":"2026-02-19T21:04:42.776003+0000","last_peered":"2026-02-19T21:04:42.776003+0000","last_clean":"2026-02-19T21:04:42.776003+0000","last_became_active":"2026-02-19T21:04:30.409098+0000","last_became_peered":"2026-02-19T21:04:30.409098+0000","last_unstale":"2026-02-19T21:04:42.776003+0000","last_undegraded":"2026-02-19T21:04:42.776003+0000","last_fullsized":"2026-02-19T21:04:42.776003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:09:56.289622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778564+0000","last_change":"2026-02-19T21:04:31.289313+0000","last_active":"2026-02-19T21:04:42.778564+0000","last_peered":"2026-02-19T21:04:42.778564+0000","last_clean":"2026-02-19T21:04:42.778564+0000","last_became_active":"2026-02-19T21:04:31.288983+0000","last_became_peered":"2026-02-19T21:04:31.288983+0000","last_unstale":"2026-02-19T21:04:42.778564+0000","last_undegraded":"2026-02-19T21:04:42.778564+0000","last_fullsized":"2026-02-19T21:04:42.778564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:56.535103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776308+0000","last_change":"2026-02-19T21:04:30.411049+0000","last_active":"2026-02-19T21:04:42.776308+0000","last_peered":"2026-02-19T21:04:42.776308+0000","last_clean":"2026-02-19T21:04:42.776308+0000","last_became_active":"2026-02-19T21:04:30.410550+0000","last_became_peered":"2026-02-19T21:04:30.410550+0000","last_unstale":"2026-02-19T21:04:42.776308+0000","last_undegraded":"2026-02-19T21:04:42.776308+0000","last_fullsized":"2026-02-19T21:04:42.776308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:08:50.397444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.779391+0000","last_change":"2026-02-19T21:04:42.779341+0000","last_active":"2026-02-19T21:04:42.779391+0000","last_peered":"2026-02-19T21:04:42.779391+0000","last_clean":"2026-02-19T21:04:42.779391+0000","last_became_active":"2026-02-19T21:04:42.779111+0000","last_became_peered":"2026-02-19T21:04:42.779111+0000","last_unstale":"2026-02-19T21:04:42.779391+0000","last_undegraded":"2026-02-19T21:04:42.779391+0000","last_fullsized":"2026-02-19T21:04:42.779391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:32:10.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.782780+0000","last_change":"2026-02-19T21:04:42.782732+0000","last_active":"2026-02-19T21:04:42.782780+0000","last_peered":"2026-02-19T21:04:42.782780+0000","last_clean":"2026-02-19T21:04:42.782780+0000","last_became_active":"2026-02-19T21:04:42.778051+0000","last_became_peered":"2026-02-19T21:04:42.778051+0000","last_unstale":"2026-02-19T21:04:42.782780+0000","last_undegraded":"2026-02-19T21:04:42.782780+0000","last_fullsized":"2026-02-19T21:04:42.782780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:02:23.826385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.774056+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:41.774056+0000","last_peered":"2026-02-19T21:04:41.774056+0000","last_clean":"2026-02-19T21:04:41.774056+0000","last_became_active":"2026-02-19T21:04:31.286657+0000","last_became_peered":"2026-02-19T21:04:31.286657+0000","last_unstale":"2026-02-19T21:04:41.774056+0000","last_undegraded":"2026-02-19T21:04:41.774056+0000","last_fullsized":"2026-02-19T21:04:41.774056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:03.670491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778820+0000","last_change":"2026-02-19T21:04:30.410815+0000","last_active":"2026-02-19T21:04:42.778820+0000","last_peered":"2026-02-19T21:04:42.778820+0000","last_clean":"2026-02-19T21:04:42.778820+0000","last_became_active":"2026-02-19T21:04:30.410567+0000","last_became_peered":"2026-02-19T21:04:30.410567+0000","last_unstale":"2026-02-19T21:04:42.778820+0000","last_undegraded":"2026-02-19T21:04:42.778820+0000","last_fullsized":"2026-02-19T21:04:42.778820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:22.307313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773870+0000","last_change":"2026-02-19T21:04:31.288226+0000","last_active":"2026-02-19T21:04:41.773870+0000","last_peered":"2026-02-19T21:04:41.773870+0000","last_clean":"2026-02-19T21:04:41.773870+0000","last_became_active":"2026-02-19T21:04:31.287964+0000","last_became_peered":"2026-02-19T21:04:31.287964+0000","last_unstale":"2026-02-19T21:04:41.773870+0000","last_undegraded":"2026-02-19T21:04:41.773870+0000","last_fullsized":"2026-02-19T21:04:41.773870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:01.589256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777700+0000","last_change":"2026-02-19T21:04:30.408483+0000","last_active":"2026-02-19T21:04:42.777700+0000","last_peered":"2026-02-19T21:04:42.777700+0000","last_clean":"2026-02-19T21:04:42.777700+0000","last_became_active":"2026-02-19T21:04:30.408255+0000","last_became_peered":"2026-02-19T21:04:30.408255+0000","last_unstale":"2026-02-19T21:04:42.777700+0000","last_undegraded":"2026-02-19T21:04:42.777700+0000","last_fullsized":"2026-02-19T21:04:42.777700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:07:16.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773974+0000","last_change":"2026-02-19T21:04:31.287796+0000","last_active":"2026-02-19T21:04:41.773974+0000","last_peered":"2026-02-19T21:04:41.773974+0000","last_clean":"2026-02-19T21:04:41.773974+0000","last_became_active":"2026-02-19T21:04:31.287536+0000","last_became_peered":"2026-02-19T21:04:31.287536+0000","last_unstale":"2026-02-19T21:04:41.773974+0000","last_undegraded":"2026-02-19T21:04:41.773974+0000","last_fullsized":"2026-02-19T21:04:41.773974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:01.470441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":349,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773806+0000","last_change":"2026-02-19T21:04:12.238272+0000","last_active":"2026-02-19T21:04:41.773806+0000","last_peered":"2026-02-19T21:04:41.773806+0000","last_clean":"2026-02-19T21:04:41.773806+0000","last_became_active":"2026-02-19T21:04:12.238014+0000","last_became_peered":"2026-02-19T21:04:12.238014+0000","last_unstale":"2026-02-19T21:04:41.773806+0000","last_undegraded":"2026-02-19T21:04:41.773806+0000","last_fullsized":"2026-02-19T21:04:41.773806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_clean_scrub_stamp":"2026-02-19T21:03:12.107531+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:05:49.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775772+0000","last_change":"2026-02-19T21:04:30.410213+0000","last_active":"2026-02-19T21:04:42.775772+0000","last_peered":"2026-02-19T21:04:42.775772+0000","last_clean":"2026-02-19T21:04:42.775772+0000","last_became_active":"2026-02-19T21:04:30.410043+0000","last_became_peered":"2026-02-19T21:04:30.410043+0000","last_unstale":"2026-02-19T21:04:42.775772+0000","last_undegraded":"2026-02-19T21:04:42.775772+0000","last_fullsized":"2026-02-19T21:04:42.775772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:34:23.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777473+0000","last_change":"2026-02-19T21:04:31.285502+0000","last_active":"2026-02-19T21:04:42.777473+0000","last_peered":"2026-02-19T21:04:42.777473+0000","last_clean":"2026-02-19T21:04:42.777473+0000","last_became_active":"2026-02-19T21:04:31.285248+0000","last_became_peered":"2026-02-19T21:04:31.285248+0000","last_unstale":"2026-02-19T21:04:42.777473+0000","last_undegraded":"2026-02-19T21:04:42.777473+0000","last_fullsized":"2026-02-19T21:04:42.777473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:54.516813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773777+0000","last_change":"2026-02-19T21:04:30.409547+0000","last_active":"2026-02-19T21:04:41.773777+0000","last_peered":"2026-02-19T21:04:41.773777+0000","last_clean":"2026-02-19T21:04:41.773777+0000","last_became_active":"2026-02-19T21:04:30.409191+0000","last_became_peered":"2026-02-19T21:04:30.409191+0000","last_unstale":"2026-02-19T21:04:41.773777+0000","last_undegraded":"2026-02-19T21:04:41.773777+0000","last_fullsized":"2026-02-19T21:04:41.773777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:14:53.157004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775028+0000","last_change":"2026-02-19T21:04:31.287071+0000","last_active":"2026-02-19T21:04:42.775028+0000","last_peered":"2026-02-19T21:04:42.775028+0000","last_clean":"2026-02-19T21:04:42.775028+0000","last_became_active":"2026-02-19T21:04:31.286826+0000","last_became_peered":"2026-02-19T21:04:31.286826+0000","last_unstale":"2026-02-19T21:04:42.775028+0000","last_undegraded":"2026-02-19T21:04:42.775028+0000","last_fullsized":"2026-02-19T21:04:42.775028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:26:22.218657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775282+0000","last_change":"2026-02-19T21:04:30.407561+0000","last_active":"2026-02-19T21:04:42.775282+0000","last_peered":"2026-02-19T21:04:42.775282+0000","last_clean":"2026-02-19T21:04:42.775282+0000","last_became_active":"2026-02-19T21:04:30.407338+0000","last_became_peered":"2026-02-19T21:04:30.407338+0000","last_unstale":"2026-02-19T21:04:42.775282+0000","last_undegraded":"2026-02-19T21:04:42.775282+0000","last_fullsized":"2026-02-19T21:04:42.775282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:54:33.062163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778802+0000","last_change":"2026-02-19T21:04:31.289132+0000","last_active":"2026-02-19T21:04:42.778802+0000","last_peered":"2026-02-19T21:04:42.778802+0000","last_clean":"2026-02-19T21:04:42.778802+0000","last_became_active":"2026-02-19T21:04:31.288397+0000","last_became_peered":"2026-02-19T21:04:31.288397+0000","last_unstale":"2026-02-19T21:04:42.778802+0000","last_undegraded":"2026-02-19T21:04:42.778802+0000","last_fullsized":"2026-02-19T21:04:42.778802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:06:10.359363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773839+0000","last_change":"2026-02-19T21:04:30.409909+0000","last_active":"2026-02-19T21:04:41.773839+0000","last_peered":"2026-02-19T21:04:41.773839+0000","last_clean":"2026-02-19T21:04:41.773839+0000","last_became_active":"2026-02-19T21:04:30.409595+0000","last_became_peered":"2026-02-19T21:04:30.409595+0000","last_unstale":"2026-02-19T21:04:41.773839+0000","last_undegraded":"2026-02-19T21:04:41.773839+0000","last_fullsized":"2026-02-19T21:04:41.773839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:34:26.108002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.806975+0000","last_change":"2026-02-19T21:04:42.806920+0000","last_active":"2026-02-19T21:04:42.806975+0000","last_peered":"2026-02-19T21:04:42.806975+0000","last_clean":"2026-02-19T21:04:42.806975+0000","last_became_active":"2026-02-19T21:04:42.806748+0000","last_became_peered":"2026-02-19T21:04:42.806748+0000","last_unstale":"2026-02-19T21:04:42.806975+0000","last_undegraded":"2026-02-19T21:04:42.806975+0000","last_fullsized":"2026-02-19T21:04:42.806975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:15:39.627995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775077+0000","last_change":"2026-02-19T21:04:30.408729+0000","last_active":"2026-02-19T21:04:42.775077+0000","last_peered":"2026-02-19T21:04:42.775077+0000","last_clean":"2026-02-19T21:04:42.775077+0000","last_became_active":"2026-02-19T21:04:30.408489+0000","last_became_peered":"2026-02-19T21:04:30.408489+0000","last_unstale":"2026-02-19T21:04:42.775077+0000","last_undegraded":"2026-02-19T21:04:42.775077+0000","last_fullsized":"2026-02-19T21:04:42.775077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:32.753162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775582+0000","last_change":"2026-02-19T21:04:31.282620+0000","last_active":"2026-02-19T21:04:42.775582+0000","last_peered":"2026-02-19T21:04:42.775582+0000","last_clean":"2026-02-19T21:04:42.775582+0000","last_became_active":"2026-02-19T21:04:31.282207+0000","last_became_peered":"2026-02-19T21:04:31.282207+0000","last_unstale":"2026-02-19T21:04:42.775582+0000","last_undegraded":"2026-02-19T21:04:42.775582+0000","last_fullsized":"2026-02-19T21:04:42.775582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:22:05.657414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776287+0000","last_change":"2026-02-19T21:04:30.412136+0000","last_active":"2026-02-19T21:04:42.776287+0000","last_peered":"2026-02-19T21:04:42.776287+0000","last_clean":"2026-02-19T21:04:42.776287+0000","last_became_active":"2026-02-19T21:04:30.412001+0000","last_became_peered":"2026-02-19T21:04:30.412001+0000","last_unstale":"2026-02-19T21:04:42.776287+0000","last_undegraded":"2026-02-19T21:04:42.776287+0000","last_fullsized":"2026-02-19T21:04:42.776287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:27:51.577913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775435+0000","last_change":"2026-02-19T21:04:31.286103+0000","last_active":"2026-02-19T21:04:42.775435+0000","last_peered":"2026-02-19T21:04:42.775435+0000","last_clean":"2026-02-19T21:04:42.775435+0000","last_became_active":"2026-02-19T21:04:31.285858+0000","last_became_peered":"2026-02-19T21:04:31.285858+0000","last_unstale":"2026-02-19T21:04:42.775435+0000","last_undegraded":"2026-02-19T21:04:42.775435+0000","last_fullsized":"2026-02-19T21:04:42.775435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:34.696574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'6","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.781483+0000","last_change":"2026-02-19T21:04:42.781437+0000","last_active":"2026-02-19T21:04:42.781483+0000","last_peered":"2026-02-19T21:04:42.781483+0000","last_clean":"2026-02-19T21:04:42.781483+0000","last_became_active":"2026-02-19T21:04:42.778147+0000","last_became_peered":"2026-02-19T21:04:42.778147+0000","last_unstale":"2026-02-19T21:04:42.781483+0000","last_undegraded":"2026-02-19T21:04:42.781483+0000","last_fullsized":"2026-02-19T21:04:42.781483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:17:33.551168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778053+0000","last_change":"2026-02-19T21:04:31.286348+0000","last_active":"2026-02-19T21:04:42.778053+0000","last_peered":"2026-02-19T21:04:42.778053+0000","last_clean":"2026-02-19T21:04:42.778053+0000","last_became_active":"2026-02-19T21:04:31.286157+0000","last_became_peered":"2026-02-19T21:04:31.286157+0000","last_unstale":"2026-02-19T21:04:42.778053+0000","last_undegraded":"2026-02-19T21:04:42.778053+0000","last_fullsized":"2026-02-19T21:04:42.778053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:57:02.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775724+0000","last_change":"2026-02-19T21:04:30.409263+0000","last_active":"2026-02-19T21:04:42.775724+0000","last_peered":"2026-02-19T21:04:42.775724+0000","last_clean":"2026-02-19T21:04:42.775724+0000","last_became_active":"2026-02-19T21:04:30.408394+0000","last_became_peered":"2026-02-19T21:04:30.408394+0000","last_unstale":"2026-02-19T21:04:42.775724+0000","last_undegraded":"2026-02-19T21:04:42.775724+0000","last_fullsized":"2026-02-19T21:04:42.775724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:15:30.665040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773889+0000","last_change":"2026-02-19T21:04:31.287859+0000","last_active":"2026-02-19T21:04:41.773889+0000","last_peered":"2026-02-19T21:04:41.773889+0000","last_clean":"2026-02-19T21:04:41.773889+0000","last_became_active":"2026-02-19T21:04:31.287687+0000","last_became_peered":"2026-02-19T21:04:31.287687+0000","last_unstale":"2026-02-19T21:04:41.773889+0000","last_undegraded":"2026-02-19T21:04:41.773889+0000","last_fullsized":"2026-02-19T21:04:41.773889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:26:18.995690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776593+0000","last_change":"2026-02-19T21:04:30.410334+0000","last_active":"2026-02-19T21:04:42.776593+0000","last_peered":"2026-02-19T21:04:42.776593+0000","last_clean":"2026-02-19T21:04:42.776593+0000","last_became_active":"2026-02-19T21:04:30.409928+0000","last_became_peered":"2026-02-19T21:04:30.409928+0000","last_unstale":"2026-02-19T21:04:42.776593+0000","last_undegraded":"2026-02-19T21:04:42.776593+0000","last_fullsized":"2026-02-19T21:04:42.776593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:21:33.041734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776017+0000","last_change":"2026-02-19T21:04:31.286369+0000","last_active":"2026-02-19T21:04:42.776017+0000","last_peered":"2026-02-19T21:04:42.776017+0000","last_clean":"2026-02-19T21:04:42.776017+0000","last_became_active":"2026-02-19T21:04:31.285908+0000","last_became_peered":"2026-02-19T21:04:31.285908+0000","last_unstale":"2026-02-19T21:04:42.776017+0000","last_undegraded":"2026-02-19T21:04:42.776017+0000","last_fullsized":"2026-02-19T21:04:42.776017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:32:23.440567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777496+0000","last_change":"2026-02-19T21:04:30.410110+0000","last_active":"2026-02-19T21:04:42.777496+0000","last_peered":"2026-02-19T21:04:42.777496+0000","last_clean":"2026-02-19T21:04:42.777496+0000","last_became_active":"2026-02-19T21:04:30.409864+0000","last_became_peered":"2026-02-19T21:04:30.409864+0000","last_unstale":"2026-02-19T21:04:42.777496+0000","last_undegraded":"2026-02-19T21:04:42.777496+0000","last_fullsized":"2026-02-19T21:04:42.777496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:58:06.526168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777103+0000","last_change":"2026-02-19T21:04:31.287332+0000","last_active":"2026-02-19T21:04:42.777103+0000","last_peered":"2026-02-19T21:04:42.777103+0000","last_clean":"2026-02-19T21:04:42.777103+0000","last_became_active":"2026-02-19T21:04:31.287112+0000","last_became_peered":"2026-02-19T21:04:31.287112+0000","last_unstale":"2026-02-19T21:04:42.777103+0000","last_undegraded":"2026-02-19T21:04:42.777103+0000","last_fullsized":"2026-02-19T21:04:42.777103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:06:33.375075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777392+0000","last_change":"2026-02-19T21:04:30.410600+0000","last_active":"2026-02-19T21:04:42.777392+0000","last_peered":"2026-02-19T21:04:42.777392+0000","last_clean":"2026-02-19T21:04:42.777392+0000","last_became_active":"2026-02-19T21:04:30.410268+0000","last_became_peered":"2026-02-19T21:04:30.410268+0000","last_unstale":"2026-02-19T21:04:42.777392+0000","last_undegraded":"2026-02-19T21:04:42.777392+0000","last_fullsized":"2026-02-19T21:04:42.777392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:41:28.323119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777507+0000","last_change":"2026-02-19T21:04:31.284350+0000","last_active":"2026-02-19T21:04:42.777507+0000","last_peered":"2026-02-19T21:04:42.777507+0000","last_clean":"2026-02-19T21:04:42.777507+0000","last_became_active":"2026-02-19T21:04:31.284130+0000","last_became_peered":"2026-02-19T21:04:31.284130+0000","last_unstale":"2026-02-19T21:04:42.777507+0000","last_undegraded":"2026-02-19T21:04:42.777507+0000","last_fullsized":"2026-02-19T21:04:42.777507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:18:19.362792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776084+0000","last_change":"2026-02-19T21:04:30.411333+0000","last_active":"2026-02-19T21:04:42.776084+0000","last_peered":"2026-02-19T21:04:42.776084+0000","last_clean":"2026-02-19T21:04:42.776084+0000","last_became_active":"2026-02-19T21:04:30.411052+0000","last_became_peered":"2026-02-19T21:04:30.411052+0000","last_unstale":"2026-02-19T21:04:42.776084+0000","last_undegraded":"2026-02-19T21:04:42.776084+0000","last_fullsized":"2026-02-19T21:04:42.776084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:13:12.351852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773834+0000","last_change":"2026-02-19T21:04:31.287054+0000","last_active":"2026-02-19T21:04:41.773834+0000","last_peered":"2026-02-19T21:04:41.773834+0000","last_clean":"2026-02-19T21:04:41.773834+0000","last_became_active":"2026-02-19T21:04:31.286548+0000","last_became_peered":"2026-02-19T21:04:31.286548+0000","last_unstale":"2026-02-19T21:04:41.773834+0000","last_undegraded":"2026-02-19T21:04:41.773834+0000","last_fullsized":"2026-02-19T21:04:41.773834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:15.932826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778708+0000","last_change":"2026-02-19T21:04:31.289365+0000","last_active":"2026-02-19T21:04:42.778708+0000","last_peered":"2026-02-19T21:04:42.778708+0000","last_clean":"2026-02-19T21:04:42.778708+0000","last_became_active":"2026-02-19T21:04:31.288986+0000","last_became_peered":"2026-02-19T21:04:31.288986+0000","last_unstale":"2026-02-19T21:04:42.778708+0000","last_undegraded":"2026-02-19T21:04:42.778708+0000","last_fullsized":"2026-02-19T21:04:42.778708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:55:08.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.785356+0000","last_change":"2026-02-19T21:04:42.785184+0000","last_active":"2026-02-19T21:04:42.785356+0000","last_peered":"2026-02-19T21:04:42.785356+0000","last_clean":"2026-02-19T21:04:42.785356+0000","last_became_active":"2026-02-19T21:04:42.779370+0000","last_became_peered":"2026-02-19T21:04:42.779370+0000","last_unstale":"2026-02-19T21:04:42.785356+0000","last_undegraded":"2026-02-19T21:04:42.785356+0000","last_fullsized":"2026-02-19T21:04:42.785356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:21:07.704927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776884+0000","last_change":"2026-02-19T21:04:31.287464+0000","last_active":"2026-02-19T21:04:42.776884+0000","last_peered":"2026-02-19T21:04:42.776884+0000","last_clean":"2026-02-19T21:04:42.776884+0000","last_became_active":"2026-02-19T21:04:31.287159+0000","last_became_peered":"2026-02-19T21:04:31.287159+0000","last_unstale":"2026-02-19T21:04:42.776884+0000","last_undegraded":"2026-02-19T21:04:42.776884+0000","last_fullsized":"2026-02-19T21:04:42.776884+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:30:26.608871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776170+0000","last_change":"2026-02-19T21:04:30.411307+0000","last_active":"2026-02-19T21:04:42.776170+0000","last_peered":"2026-02-19T21:04:42.776170+0000","last_clean":"2026-02-19T21:04:42.776170+0000","last_became_active":"2026-02-19T21:04:30.411044+0000","last_became_peered":"2026-02-19T21:04:30.411044+0000","last_unstale":"2026-02-19T21:04:42.776170+0000","last_undegraded":"2026-02-19T21:04:42.776170+0000","last_fullsized":"2026-02-19T21:04:42.776170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:39:22.516979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773860+0000","last_change":"2026-02-19T21:04:31.286139+0000","last_active":"2026-02-19T21:04:41.773860+0000","last_peered":"2026-02-19T21:04:41.773860+0000","last_clean":"2026-02-19T21:04:41.773860+0000","last_became_active":"2026-02-19T21:04:31.285718+0000","last_became_peered":"2026-02-19T21:04:31.285718+0000","last_unstale":"2026-02-19T21:04:41.773860+0000","last_undegraded":"2026-02-19T21:04:41.773860+0000","last_fullsized":"2026-02-19T21:04:41.773860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:15:18.002138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777943+0000","last_change":"2026-02-19T21:04:30.410568+0000","last_active":"2026-02-19T21:04:42.777943+0000","last_peered":"2026-02-19T21:04:42.777943+0000","last_clean":"2026-02-19T21:04:42.777943+0000","last_became_active":"2026-02-19T21:04:30.410323+0000","last_became_peered":"2026-02-19T21:04:30.410323+0000","last_unstale":"2026-02-19T21:04:42.777943+0000","last_undegraded":"2026-02-19T21:04:42.777943+0000","last_fullsized":"2026-02-19T21:04:42.777943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:14:30.270933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777889+0000","last_change":"2026-02-19T21:04:31.286019+0000","last_active":"2026-02-19T21:04:42.777889+0000","last_peered":"2026-02-19T21:04:42.777889+0000","last_clean":"2026-02-19T21:04:42.777889+0000","last_became_active":"2026-02-19T21:04:31.285608+0000","last_became_peered":"2026-02-19T21:04:31.285608+0000","last_unstale":"2026-02-19T21:04:42.777889+0000","last_undegraded":"2026-02-19T21:04:42.777889+0000","last_fullsized":"2026-02-19T21:04:42.777889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:34:30.034673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775542+0000","last_change":"2026-02-19T21:04:30.409329+0000","last_active":"2026-02-19T21:04:42.775542+0000","last_peered":"2026-02-19T21:04:42.775542+0000","last_clean":"2026-02-19T21:04:42.775542+0000","last_became_active":"2026-02-19T21:04:30.408892+0000","last_became_peered":"2026-02-19T21:04:30.408892+0000","last_unstale":"2026-02-19T21:04:42.775542+0000","last_undegraded":"2026-02-19T21:04:42.775542+0000","last_fullsized":"2026-02-19T21:04:42.775542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:16:52.316860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56930,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":65,"num_read_kb":88,"num_write":146,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":52844,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":170790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":176795,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710727,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":403563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9792,"internal_metadata":27580864},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939657,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28456,"kb_used_data":1492,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733974744,"statfs":{"total":751619276800,"available":751590137856,"internally_reserved":0,"allocated":1527808,"data_stored":1056329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28798,"internal_metadata":27561858},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":403799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25347,"internal_metadata":27565309},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299405,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":412160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21936,"internal_metadata":27568720},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528333,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28368,"kb_used_data":1404,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733974832,"statfs":{"total":751619276800,"available":751590227968,"internally_reserved":0,"allocated":1437696,"data_stored":995668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33900,"internal_metadata":27556756},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":411607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28371,"internal_metadata":27562285},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888080,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28380,"kb_used_data":1416,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733974820,"statfs":{"total":751619276800,"available":751590215680,"internally_reserved":0,"allocated":1449984,"data_stored":995352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20482,"internal_metadata":27570174},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":464888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40797,"internal_metadata":27549859},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247828,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":403477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47469,"internal_metadata":27543187},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27864,"kb_used_data":840,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975336,"statfs":{"total":751619276800,"available":751590744064,"internally_reserved":0,"allocated":860160,"data_stored":413182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49824,"internal_metadata":27540832},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607574,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27828,"kb_used_data":864,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975372,"statfs":{"total":751619276800,"available":751590780928,"internally_reserved":0,"allocated":884736,"data_stored":455803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44971,"internal_metadata":27545685},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":404481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49081,"internal_metadata":27541575},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47346,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1896,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13758,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19456,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17429,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6303,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20607,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11216,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16324,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12919,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4232,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-19T21:04:45.341 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph pg dump --format=json 2026-02-19T21:04:45.496 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:45.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/19532227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810fbf0 msgr2=0x7fa1d8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/19532227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810fbf0 0x7fa1d8114c30 secure :-1 s=READY pgs=304 gs=2 cs=0 l=1 c_cookie=14829950020788712685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1c00099a0 tx=0x7fa1c002ed50 comp rx=0 tx=0).stop 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/19532227 shutdown_connections 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/19532227 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 0x7fa1d8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/19532227 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810fbf0 0x7fa1d8114c30 unknown :-1 s=CLOSED pgs=304 gs=2 cs=0 l=1 c_cookie=14829950020788712685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/19532227 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa1d810f200 0x7fa1d810f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/19532227 >> 10.20.193.90:0/19532227 conn(0x7fa1d80ecac0 msgr2=0x7fa1d810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/19532227 shutdown_connections 2026-02-19T21:04:45.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/19532227 wait complete. 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 Processor -- start 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- start start 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 0x7fa1d80f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 0x7fa1d8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa1d80f5220 0x7fa1d80fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d80f5910 con 0x7fa1d810f200 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d80faa30 con 0x7fa1d8115410 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.611+0000 7fa1dd7206c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d80fabf0 con 0x7fa1d80f5220 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 0x7fa1d80f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 0x7fa1d80f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43236/0 (socket says 10.20.193.90:43236) 2026-02-19T21:04:45.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 -- 10.20.193.90:0/2404039882 learned_addr learned my addr 10.20.193.90:0/2404039882 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d77fe6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa1d80f5220 0x7fa1d80fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d67fc6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 0x7fa1d8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 -- 10.20.193.90:0/2404039882 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa1d80f5220 msgr2=0x7fa1d80fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa1d80f5220 0x7fa1d80fa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 -- 10.20.193.90:0/2404039882 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 msgr2=0x7fa1d8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 0x7fa1d8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 -- 10.20.193.90:0/2404039882 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c0009590 con 0x7fa1d810f200 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d67fc6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 0x7fa1d8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1d6ffd6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 0x7fa1d80f4bf0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1cc00b710 tx=0x7fa1cc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1cc004250 con 0x7fa1d810f200 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa1cc009070 con 0x7fa1d810f200 2026-02-19T21:04:45.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d80faed0 con 0x7fa1d810f200 2026-02-19T21:04:45.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1cc00ccd0 con 0x7fa1d810f200 2026-02-19T21:04:45.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d80fb660 con 0x7fa1d810f200 2026-02-19T21:04:45.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.612+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d81104d0 con 0x7fa1d810f200 2026-02-19T21:04:45.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.614+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fa1cc0028c0 con 0x7fa1d810f200 2026-02-19T21:04:45.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.614+0000 7fa1b7fff6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa1ac0b56e0 0x7fa1ac0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:45.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.615+0000 7fa1d67fc6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa1ac0b56e0 0x7fa1ac0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:45.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.615+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fa1cc0e3e90 con 0x7fa1d810f200 2026-02-19T21:04:45.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.615+0000 7fa1d67fc6c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa1ac0b56e0 0x7fa1ac0d5b90 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d80fb580 tx=0x7fa1c00023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:45.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.615+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa1cc0e4380 con 0x7fa1d810f200 2026-02-19T21:04:45.705 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.704+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 --> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1d80f5d70 con 0x7fa1ac0b56e0 2026-02-19T21:04:45.706 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.706+0000 7fa1b7fff6c0 1 -- 10.20.193.90:0/2404039882 <== mgr.14193 v2:10.20.193.90:6800/151235046 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258838 (secure 0 0 0) 0x7fa1d80f5d70 con 0x7fa1ac0b56e0 2026-02-19T21:04:45.710 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:45.712 INFO:teuthology.orchestra.run.trial090.stderr:dumped all 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa1ac0b56e0 msgr2=0x7fa1ac0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa1ac0b56e0 0x7fa1ac0d5b90 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d80fb580 tx=0x7fa1c00023a0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 msgr2=0x7fa1d80f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 0x7fa1d80f4bf0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1cc00b710 tx=0x7fa1cc00bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 shutdown_connections 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa1ac0b56e0 0x7fa1ac0d5b90 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.715 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa1d80f5220 0x7fa1d80fa4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa1d8115410 0x7fa1d8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 --2- 10.20.193.90:0/2404039882 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa1d810f200 0x7fa1d80f4bf0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:45.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 >> 10.20.193.90:0/2404039882 conn(0x7fa1d80ecac0 msgr2=0x7fa1d8113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:45.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 shutdown_connections 2026-02-19T21:04:45.716 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:45.707+0000 7fa1dd7206c0 1 -- 10.20.193.90:0/2404039882 wait complete. 2026-02-19T21:04:45.746 INFO:teuthology.orchestra.run.trial090.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2026-02-19T21:04:44.880159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647532,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":179,"num_read_kb":187,"num_write":337,"num_write_kb":3822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1233580,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":281,"ondisk_log_size":281,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":335484,"kb_used_data":11856,"kb_used_omap":391,"kb_used_meta":322936,"kb_avail":8807702916,"statfs":{"total":9019431321600,"available":9019087785984,"internally_reserved":0,"allocated":12140544,"data_stored":6820309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":400768,"internal_metadata":330687104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":53484,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":65,"num_read_kb":88,"num_write":79,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":52844,"num_keys_recovered":11,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001841"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777336+0000","last_change":"2026-02-19T21:04:31.287002+0000","last_active":"2026-02-19T21:04:42.777336+0000","last_peered":"2026-02-19T21:04:42.777336+0000","last_clean":"2026-02-19T21:04:42.777336+0000","last_became_active":"2026-02-19T21:04:31.286342+0000","last_became_peered":"2026-02-19T21:04:31.286342+0000","last_unstale":"2026-02-19T21:04:42.777336+0000","last_undegraded":"2026-02-19T21:04:42.777336+0000","last_fullsized":"2026-02-19T21:04:42.777336+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:10:00.790374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773812+0000","last_change":"2026-02-19T21:04:31.285136+0000","last_active":"2026-02-19T21:04:41.773812+0000","last_peered":"2026-02-19T21:04:41.773812+0000","last_clean":"2026-02-19T21:04:41.773812+0000","last_became_active":"2026-02-19T21:04:31.284945+0000","last_became_peered":"2026-02-19T21:04:31.284945+0000","last_unstale":"2026-02-19T21:04:41.773812+0000","last_undegraded":"2026-02-19T21:04:41.773812+0000","last_fullsized":"2026-02-19T21:04:41.773812+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:08:07.726305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773704+0000","last_change":"2026-02-19T21:04:31.286791+0000","last_active":"2026-02-19T21:04:41.773704+0000","last_peered":"2026-02-19T21:04:41.773704+0000","last_clean":"2026-02-19T21:04:41.773704+0000","last_became_active":"2026-02-19T21:04:31.286150+0000","last_became_peered":"2026-02-19T21:04:31.286150+0000","last_unstale":"2026-02-19T21:04:41.773704+0000","last_undegraded":"2026-02-19T21:04:41.773704+0000","last_fullsized":"2026-02-19T21:04:41.773704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:29:44.208057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775649+0000","last_change":"2026-02-19T21:04:31.287914+0000","last_active":"2026-02-19T21:04:42.775649+0000","last_peered":"2026-02-19T21:04:42.775649+0000","last_clean":"2026-02-19T21:04:42.775649+0000","last_became_active":"2026-02-19T21:04:31.287376+0000","last_became_peered":"2026-02-19T21:04:31.287376+0000","last_unstale":"2026-02-19T21:04:42.775649+0000","last_undegraded":"2026-02-19T21:04:42.775649+0000","last_fullsized":"2026-02-19T21:04:42.775649+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:27:40.549645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776061+0000","last_change":"2026-02-19T21:04:31.286299+0000","last_active":"2026-02-19T21:04:42.776061+0000","last_peered":"2026-02-19T21:04:42.776061+0000","last_clean":"2026-02-19T21:04:42.776061+0000","last_became_active":"2026-02-19T21:04:31.285600+0000","last_became_peered":"2026-02-19T21:04:31.285600+0000","last_unstale":"2026-02-19T21:04:42.776061+0000","last_undegraded":"2026-02-19T21:04:42.776061+0000","last_fullsized":"2026-02-19T21:04:42.776061+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:26:00.465870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775549+0000","last_change":"2026-02-19T21:04:31.285609+0000","last_active":"2026-02-19T21:04:42.775549+0000","last_peered":"2026-02-19T21:04:42.775549+0000","last_clean":"2026-02-19T21:04:42.775549+0000","last_became_active":"2026-02-19T21:04:31.285465+0000","last_became_peered":"2026-02-19T21:04:31.285465+0000","last_unstale":"2026-02-19T21:04:42.775549+0000","last_undegraded":"2026-02-19T21:04:42.775549+0000","last_fullsized":"2026-02-19T21:04:42.775549+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:10.356903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773710+0000","last_change":"2026-02-19T21:04:31.287193+0000","last_active":"2026-02-19T21:04:41.773710+0000","last_peered":"2026-02-19T21:04:41.773710+0000","last_clean":"2026-02-19T21:04:41.773710+0000","last_became_active":"2026-02-19T21:04:31.286850+0000","last_became_peered":"2026-02-19T21:04:31.286850+0000","last_unstale":"2026-02-19T21:04:41.773710+0000","last_undegraded":"2026-02-19T21:04:41.773710+0000","last_fullsized":"2026-02-19T21:04:41.773710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:51:50.866916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.779068+0000","last_change":"2026-02-19T21:04:42.778626+0000","last_active":"2026-02-19T21:04:42.779068+0000","last_peered":"2026-02-19T21:04:42.779068+0000","last_clean":"2026-02-19T21:04:42.779068+0000","last_became_active":"2026-02-19T21:04:42.778275+0000","last_became_peered":"2026-02-19T21:04:42.778275+0000","last_unstale":"2026-02-19T21:04:42.779068+0000","last_undegraded":"2026-02-19T21:04:42.779068+0000","last_fullsized":"2026-02-19T21:04:42.779068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:21:39.285117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776842+0000","last_change":"2026-02-19T21:04:31.288496+0000","last_active":"2026-02-19T21:04:42.776842+0000","last_peered":"2026-02-19T21:04:42.776842+0000","last_clean":"2026-02-19T21:04:42.776842+0000","last_became_active":"2026-02-19T21:04:31.288194+0000","last_became_peered":"2026-02-19T21:04:31.288194+0000","last_unstale":"2026-02-19T21:04:42.776842+0000","last_undegraded":"2026-02-19T21:04:42.776842+0000","last_fullsized":"2026-02-19T21:04:42.776842+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:00:28.688159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775739+0000","last_change":"2026-02-19T21:04:31.288303+0000","last_active":"2026-02-19T21:04:42.775739+0000","last_peered":"2026-02-19T21:04:42.775739+0000","last_clean":"2026-02-19T21:04:42.775739+0000","last_became_active":"2026-02-19T21:04:31.288160+0000","last_became_peered":"2026-02-19T21:04:31.288160+0000","last_unstale":"2026-02-19T21:04:42.775739+0000","last_undegraded":"2026-02-19T21:04:42.775739+0000","last_fullsized":"2026-02-19T21:04:42.775739+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:47:29.467905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773970+0000","last_change":"2026-02-19T21:04:31.287633+0000","last_active":"2026-02-19T21:04:41.773970+0000","last_peered":"2026-02-19T21:04:41.773970+0000","last_clean":"2026-02-19T21:04:41.773970+0000","last_became_active":"2026-02-19T21:04:31.287434+0000","last_became_peered":"2026-02-19T21:04:31.287434+0000","last_unstale":"2026-02-19T21:04:41.773970+0000","last_undegraded":"2026-02-19T21:04:41.773970+0000","last_fullsized":"2026-02-19T21:04:41.773970+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:34:20.533516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775709+0000","last_change":"2026-02-19T21:04:31.288404+0000","last_active":"2026-02-19T21:04:42.775709+0000","last_peered":"2026-02-19T21:04:42.775709+0000","last_clean":"2026-02-19T21:04:42.775709+0000","last_became_active":"2026-02-19T21:04:31.287620+0000","last_became_peered":"2026-02-19T21:04:31.287620+0000","last_unstale":"2026-02-19T21:04:42.775709+0000","last_undegraded":"2026-02-19T21:04:42.775709+0000","last_fullsized":"2026-02-19T21:04:42.775709+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:42:25.760231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775177+0000","last_change":"2026-02-19T21:04:31.285595+0000","last_active":"2026-02-19T21:04:42.775177+0000","last_peered":"2026-02-19T21:04:42.775177+0000","last_clean":"2026-02-19T21:04:42.775177+0000","last_became_active":"2026-02-19T21:04:31.285372+0000","last_became_peered":"2026-02-19T21:04:31.285372+0000","last_unstale":"2026-02-19T21:04:42.775177+0000","last_undegraded":"2026-02-19T21:04:42.775177+0000","last_fullsized":"2026-02-19T21:04:42.775177+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:35.546455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773611+0000","last_change":"2026-02-19T21:04:31.284499+0000","last_active":"2026-02-19T21:04:41.773611+0000","last_peered":"2026-02-19T21:04:41.773611+0000","last_clean":"2026-02-19T21:04:41.773611+0000","last_became_active":"2026-02-19T21:04:31.284262+0000","last_became_peered":"2026-02-19T21:04:31.284262+0000","last_unstale":"2026-02-19T21:04:41.773611+0000","last_undegraded":"2026-02-19T21:04:41.773611+0000","last_fullsized":"2026-02-19T21:04:41.773611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:48:14.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773585+0000","last_change":"2026-02-19T21:04:31.287280+0000","last_active":"2026-02-19T21:04:41.773585+0000","last_peered":"2026-02-19T21:04:41.773585+0000","last_clean":"2026-02-19T21:04:41.773585+0000","last_became_active":"2026-02-19T21:04:31.287026+0000","last_became_peered":"2026-02-19T21:04:31.287026+0000","last_unstale":"2026-02-19T21:04:41.773585+0000","last_undegraded":"2026-02-19T21:04:41.773585+0000","last_fullsized":"2026-02-19T21:04:41.773585+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:15:11.357321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776564+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:42.776564+0000","last_peered":"2026-02-19T21:04:42.776564+0000","last_clean":"2026-02-19T21:04:42.776564+0000","last_became_active":"2026-02-19T21:04:31.286591+0000","last_became_peered":"2026-02-19T21:04:31.286591+0000","last_unstale":"2026-02-19T21:04:42.776564+0000","last_undegraded":"2026-02-19T21:04:42.776564+0000","last_fullsized":"2026-02-19T21:04:42.776564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:24:52.717294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777489+0000","last_change":"2026-02-19T21:04:31.287192+0000","last_active":"2026-02-19T21:04:42.777489+0000","last_peered":"2026-02-19T21:04:42.777489+0000","last_clean":"2026-02-19T21:04:42.777489+0000","last_became_active":"2026-02-19T21:04:31.287005+0000","last_became_peered":"2026-02-19T21:04:31.287005+0000","last_unstale":"2026-02-19T21:04:42.777489+0000","last_undegraded":"2026-02-19T21:04:42.777489+0000","last_fullsized":"2026-02-19T21:04:42.777489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:34:18.523767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775384+0000","last_change":"2026-02-19T21:04:31.285298+0000","last_active":"2026-02-19T21:04:42.775384+0000","last_peered":"2026-02-19T21:04:42.775384+0000","last_clean":"2026-02-19T21:04:42.775384+0000","last_became_active":"2026-02-19T21:04:31.285047+0000","last_became_peered":"2026-02-19T21:04:31.285047+0000","last_unstale":"2026-02-19T21:04:42.775384+0000","last_undegraded":"2026-02-19T21:04:42.775384+0000","last_fullsized":"2026-02-19T21:04:42.775384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:32:45.124589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777490+0000","last_change":"2026-02-19T21:04:31.287399+0000","last_active":"2026-02-19T21:04:42.777490+0000","last_peered":"2026-02-19T21:04:42.777490+0000","last_clean":"2026-02-19T21:04:42.777490+0000","last_became_active":"2026-02-19T21:04:31.286835+0000","last_became_peered":"2026-02-19T21:04:31.286835+0000","last_unstale":"2026-02-19T21:04:42.777490+0000","last_undegraded":"2026-02-19T21:04:42.777490+0000","last_fullsized":"2026-02-19T21:04:42.777490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:16.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777661+0000","last_change":"2026-02-19T21:04:31.288156+0000","last_active":"2026-02-19T21:04:42.777661+0000","last_peered":"2026-02-19T21:04:42.777661+0000","last_clean":"2026-02-19T21:04:42.777661+0000","last_became_active":"2026-02-19T21:04:31.288012+0000","last_became_peered":"2026-02-19T21:04:31.288012+0000","last_unstale":"2026-02-19T21:04:42.777661+0000","last_undegraded":"2026-02-19T21:04:42.777661+0000","last_fullsized":"2026-02-19T21:04:42.777661+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:05:48.712920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775209+0000","last_change":"2026-02-19T21:04:31.285690+0000","last_active":"2026-02-19T21:04:42.775209+0000","last_peered":"2026-02-19T21:04:42.775209+0000","last_clean":"2026-02-19T21:04:42.775209+0000","last_became_active":"2026-02-19T21:04:31.285498+0000","last_became_peered":"2026-02-19T21:04:31.285498+0000","last_unstale":"2026-02-19T21:04:42.775209+0000","last_undegraded":"2026-02-19T21:04:42.775209+0000","last_fullsized":"2026-02-19T21:04:42.775209+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:48:40.789834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776595+0000","last_change":"2026-02-19T21:04:31.288360+0000","last_active":"2026-02-19T21:04:42.776595+0000","last_peered":"2026-02-19T21:04:42.776595+0000","last_clean":"2026-02-19T21:04:42.776595+0000","last_became_active":"2026-02-19T21:04:31.287849+0000","last_became_peered":"2026-02-19T21:04:31.287849+0000","last_unstale":"2026-02-19T21:04:42.776595+0000","last_undegraded":"2026-02-19T21:04:42.776595+0000","last_fullsized":"2026-02-19T21:04:42.776595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:24:06.399904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777191+0000","last_change":"2026-02-19T21:04:31.286420+0000","last_active":"2026-02-19T21:04:42.777191+0000","last_peered":"2026-02-19T21:04:42.777191+0000","last_clean":"2026-02-19T21:04:42.777191+0000","last_became_active":"2026-02-19T21:04:31.285905+0000","last_became_peered":"2026-02-19T21:04:31.285905+0000","last_unstale":"2026-02-19T21:04:42.777191+0000","last_undegraded":"2026-02-19T21:04:42.777191+0000","last_fullsized":"2026-02-19T21:04:42.777191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:07:02.537538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778771+0000","last_change":"2026-02-19T21:04:31.288706+0000","last_active":"2026-02-19T21:04:42.778771+0000","last_peered":"2026-02-19T21:04:42.778771+0000","last_clean":"2026-02-19T21:04:42.778771+0000","last_became_active":"2026-02-19T21:04:31.287837+0000","last_became_peered":"2026-02-19T21:04:31.287837+0000","last_unstale":"2026-02-19T21:04:42.778771+0000","last_undegraded":"2026-02-19T21:04:42.778771+0000","last_fullsized":"2026-02-19T21:04:42.778771+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:33:01.082715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777972+0000","last_change":"2026-02-19T21:04:31.286807+0000","last_active":"2026-02-19T21:04:42.777972+0000","last_peered":"2026-02-19T21:04:42.777972+0000","last_clean":"2026-02-19T21:04:42.777972+0000","last_became_active":"2026-02-19T21:04:31.286555+0000","last_became_peered":"2026-02-19T21:04:31.286555+0000","last_unstale":"2026-02-19T21:04:42.777972+0000","last_undegraded":"2026-02-19T21:04:42.777972+0000","last_fullsized":"2026-02-19T21:04:42.777972+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:09:33.064392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777589+0000","last_change":"2026-02-19T21:04:31.288135+0000","last_active":"2026-02-19T21:04:42.777589+0000","last_peered":"2026-02-19T21:04:42.777589+0000","last_clean":"2026-02-19T21:04:42.777589+0000","last_became_active":"2026-02-19T21:04:31.287889+0000","last_became_peered":"2026-02-19T21:04:31.287889+0000","last_unstale":"2026-02-19T21:04:42.777589+0000","last_undegraded":"2026-02-19T21:04:42.777589+0000","last_fullsized":"2026-02-19T21:04:42.777589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:41:33.753704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777191+0000","last_change":"2026-02-19T21:04:31.286954+0000","last_active":"2026-02-19T21:04:42.777191+0000","last_peered":"2026-02-19T21:04:42.777191+0000","last_clean":"2026-02-19T21:04:42.777191+0000","last_became_active":"2026-02-19T21:04:31.286509+0000","last_became_peered":"2026-02-19T21:04:31.286509+0000","last_unstale":"2026-02-19T21:04:42.777191+0000","last_undegraded":"2026-02-19T21:04:42.777191+0000","last_fullsized":"2026-02-19T21:04:42.777191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:19:03.051404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775190+0000","last_change":"2026-02-19T21:04:31.288452+0000","last_active":"2026-02-19T21:04:42.775190+0000","last_peered":"2026-02-19T21:04:42.775190+0000","last_clean":"2026-02-19T21:04:42.775190+0000","last_became_active":"2026-02-19T21:04:31.288288+0000","last_became_peered":"2026-02-19T21:04:31.288288+0000","last_unstale":"2026-02-19T21:04:42.775190+0000","last_undegraded":"2026-02-19T21:04:42.775190+0000","last_fullsized":"2026-02-19T21:04:42.775190+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:36:20.116850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773786+0000","last_change":"2026-02-19T21:04:31.287437+0000","last_active":"2026-02-19T21:04:41.773786+0000","last_peered":"2026-02-19T21:04:41.773786+0000","last_clean":"2026-02-19T21:04:41.773786+0000","last_became_active":"2026-02-19T21:04:31.287292+0000","last_became_peered":"2026-02-19T21:04:31.287292+0000","last_unstale":"2026-02-19T21:04:41.773786+0000","last_undegraded":"2026-02-19T21:04:41.773786+0000","last_fullsized":"2026-02-19T21:04:41.773786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:25:27.235359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777328+0000","last_change":"2026-02-19T21:04:31.286030+0000","last_active":"2026-02-19T21:04:42.777328+0000","last_peered":"2026-02-19T21:04:42.777328+0000","last_clean":"2026-02-19T21:04:42.777328+0000","last_became_active":"2026-02-19T21:04:31.285556+0000","last_became_peered":"2026-02-19T21:04:31.285556+0000","last_unstale":"2026-02-19T21:04:42.777328+0000","last_undegraded":"2026-02-19T21:04:42.777328+0000","last_fullsized":"2026-02-19T21:04:42.777328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:09:01.348835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777502+0000","last_change":"2026-02-19T21:04:31.289211+0000","last_active":"2026-02-19T21:04:42.777502+0000","last_peered":"2026-02-19T21:04:42.777502+0000","last_clean":"2026-02-19T21:04:42.777502+0000","last_became_active":"2026-02-19T21:04:31.288961+0000","last_became_peered":"2026-02-19T21:04:31.288961+0000","last_unstale":"2026-02-19T21:04:42.777502+0000","last_undegraded":"2026-02-19T21:04:42.777502+0000","last_fullsized":"2026-02-19T21:04:42.777502+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:03:11.179940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777063+0000","last_change":"2026-02-19T21:04:31.288628+0000","last_active":"2026-02-19T21:04:42.777063+0000","last_peered":"2026-02-19T21:04:42.777063+0000","last_clean":"2026-02-19T21:04:42.777063+0000","last_became_active":"2026-02-19T21:04:31.288458+0000","last_became_peered":"2026-02-19T21:04:31.288458+0000","last_unstale":"2026-02-19T21:04:42.777063+0000","last_undegraded":"2026-02-19T21:04:42.777063+0000","last_fullsized":"2026-02-19T21:04:42.777063+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:24:59.338008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776112+0000","last_change":"2026-02-19T21:04:31.287078+0000","last_active":"2026-02-19T21:04:42.776112+0000","last_peered":"2026-02-19T21:04:42.776112+0000","last_clean":"2026-02-19T21:04:42.776112+0000","last_became_active":"2026-02-19T21:04:31.286730+0000","last_became_peered":"2026-02-19T21:04:31.286730+0000","last_unstale":"2026-02-19T21:04:42.776112+0000","last_undegraded":"2026-02-19T21:04:42.776112+0000","last_fullsized":"2026-02-19T21:04:42.776112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:52:57.154998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778761+0000","last_change":"2026-02-19T21:04:30.410537+0000","last_active":"2026-02-19T21:04:42.778761+0000","last_peered":"2026-02-19T21:04:42.778761+0000","last_clean":"2026-02-19T21:04:42.778761+0000","last_became_active":"2026-02-19T21:04:30.410253+0000","last_became_peered":"2026-02-19T21:04:30.410253+0000","last_unstale":"2026-02-19T21:04:42.778761+0000","last_undegraded":"2026-02-19T21:04:42.778761+0000","last_fullsized":"2026-02-19T21:04:42.778761+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:43:09.872775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.779367+0000","last_change":"2026-02-19T21:04:42.778950+0000","last_active":"2026-02-19T21:04:42.779367+0000","last_peered":"2026-02-19T21:04:42.779367+0000","last_clean":"2026-02-19T21:04:42.779367+0000","last_became_active":"2026-02-19T21:04:42.778721+0000","last_became_peered":"2026-02-19T21:04:42.778721+0000","last_unstale":"2026-02-19T21:04:42.779367+0000","last_undegraded":"2026-02-19T21:04:42.779367+0000","last_fullsized":"2026-02-19T21:04:42.779367+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:35:19.647044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775514+0000","last_change":"2026-02-19T21:04:30.411183+0000","last_active":"2026-02-19T21:04:42.775514+0000","last_peered":"2026-02-19T21:04:42.775514+0000","last_clean":"2026-02-19T21:04:42.775514+0000","last_became_active":"2026-02-19T21:04:30.410927+0000","last_became_peered":"2026-02-19T21:04:30.410927+0000","last_unstale":"2026-02-19T21:04:42.775514+0000","last_undegraded":"2026-02-19T21:04:42.775514+0000","last_fullsized":"2026-02-19T21:04:42.775514+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:27:37.758407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775028+0000","last_change":"2026-02-19T21:04:30.407656+0000","last_active":"2026-02-19T21:04:42.775028+0000","last_peered":"2026-02-19T21:04:42.775028+0000","last_clean":"2026-02-19T21:04:42.775028+0000","last_became_active":"2026-02-19T21:04:30.407355+0000","last_became_peered":"2026-02-19T21:04:30.407355+0000","last_unstale":"2026-02-19T21:04:42.775028+0000","last_undegraded":"2026-02-19T21:04:42.775028+0000","last_fullsized":"2026-02-19T21:04:42.775028+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:45:24.893068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777237+0000","last_change":"2026-02-19T21:04:31.282577+0000","last_active":"2026-02-19T21:04:42.777237+0000","last_peered":"2026-02-19T21:04:42.777237+0000","last_clean":"2026-02-19T21:04:42.777237+0000","last_became_active":"2026-02-19T21:04:31.282337+0000","last_became_peered":"2026-02-19T21:04:31.282337+0000","last_unstale":"2026-02-19T21:04:42.777237+0000","last_undegraded":"2026-02-19T21:04:42.777237+0000","last_fullsized":"2026-02-19T21:04:42.777237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:16:10.971557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778995+0000","last_change":"2026-02-19T21:04:30.409768+0000","last_active":"2026-02-19T21:04:42.778995+0000","last_peered":"2026-02-19T21:04:42.778995+0000","last_clean":"2026-02-19T21:04:42.778995+0000","last_became_active":"2026-02-19T21:04:30.409536+0000","last_became_peered":"2026-02-19T21:04:30.409536+0000","last_unstale":"2026-02-19T21:04:42.778995+0000","last_undegraded":"2026-02-19T21:04:42.778995+0000","last_fullsized":"2026-02-19T21:04:42.778995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:59.805182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.774967+0000","last_change":"2026-02-19T21:04:31.284256+0000","last_active":"2026-02-19T21:04:42.774967+0000","last_peered":"2026-02-19T21:04:42.774967+0000","last_clean":"2026-02-19T21:04:42.774967+0000","last_became_active":"2026-02-19T21:04:31.284072+0000","last_became_peered":"2026-02-19T21:04:31.284072+0000","last_unstale":"2026-02-19T21:04:42.774967+0000","last_undegraded":"2026-02-19T21:04:42.774967+0000","last_fullsized":"2026-02-19T21:04:42.774967+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:06:45.684098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775706+0000","last_change":"2026-02-19T21:04:30.411605+0000","last_active":"2026-02-19T21:04:42.775706+0000","last_peered":"2026-02-19T21:04:42.775706+0000","last_clean":"2026-02-19T21:04:42.775706+0000","last_became_active":"2026-02-19T21:04:30.411457+0000","last_became_peered":"2026-02-19T21:04:30.411457+0000","last_unstale":"2026-02-19T21:04:42.775706+0000","last_undegraded":"2026-02-19T21:04:42.775706+0000","last_fullsized":"2026-02-19T21:04:42.775706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:03:03.301109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776855+0000","last_change":"2026-02-19T21:04:31.286695+0000","last_active":"2026-02-19T21:04:42.776855+0000","last_peered":"2026-02-19T21:04:42.776855+0000","last_clean":"2026-02-19T21:04:42.776855+0000","last_became_active":"2026-02-19T21:04:31.286522+0000","last_became_peered":"2026-02-19T21:04:31.286522+0000","last_unstale":"2026-02-19T21:04:42.776855+0000","last_undegraded":"2026-02-19T21:04:42.776855+0000","last_fullsized":"2026-02-19T21:04:42.776855+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:49:26.698378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773944+0000","last_change":"2026-02-19T21:04:30.409642+0000","last_active":"2026-02-19T21:04:41.773944+0000","last_peered":"2026-02-19T21:04:41.773944+0000","last_clean":"2026-02-19T21:04:41.773944+0000","last_became_active":"2026-02-19T21:04:30.409369+0000","last_became_peered":"2026-02-19T21:04:30.409369+0000","last_unstale":"2026-02-19T21:04:41.773944+0000","last_undegraded":"2026-02-19T21:04:41.773944+0000","last_fullsized":"2026-02-19T21:04:41.773944+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:42:09.905781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773901+0000","last_change":"2026-02-19T21:04:31.287134+0000","last_active":"2026-02-19T21:04:41.773901+0000","last_peered":"2026-02-19T21:04:41.773901+0000","last_clean":"2026-02-19T21:04:41.773901+0000","last_became_active":"2026-02-19T21:04:31.286957+0000","last_became_peered":"2026-02-19T21:04:31.286957+0000","last_unstale":"2026-02-19T21:04:41.773901+0000","last_undegraded":"2026-02-19T21:04:41.773901+0000","last_fullsized":"2026-02-19T21:04:41.773901+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:20:14.188668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778710+0000","last_change":"2026-02-19T21:04:30.410806+0000","last_active":"2026-02-19T21:04:42.778710+0000","last_peered":"2026-02-19T21:04:42.778710+0000","last_clean":"2026-02-19T21:04:42.778710+0000","last_became_active":"2026-02-19T21:04:30.410547+0000","last_became_peered":"2026-02-19T21:04:30.410547+0000","last_unstale":"2026-02-19T21:04:42.778710+0000","last_undegraded":"2026-02-19T21:04:42.778710+0000","last_fullsized":"2026-02-19T21:04:42.778710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:43:04.471874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776899+0000","last_change":"2026-02-19T21:04:31.288726+0000","last_active":"2026-02-19T21:04:42.776899+0000","last_peered":"2026-02-19T21:04:42.776899+0000","last_clean":"2026-02-19T21:04:42.776899+0000","last_became_active":"2026-02-19T21:04:31.288355+0000","last_became_peered":"2026-02-19T21:04:31.288355+0000","last_unstale":"2026-02-19T21:04:42.776899+0000","last_undegraded":"2026-02-19T21:04:42.776899+0000","last_fullsized":"2026-02-19T21:04:42.776899+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:23:35.206511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'22","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.780127+0000","last_change":"2026-02-19T21:04:42.780085+0000","last_active":"2026-02-19T21:04:42.780127+0000","last_peered":"2026-02-19T21:04:42.780127+0000","last_clean":"2026-02-19T21:04:42.780127+0000","last_became_active":"2026-02-19T21:04:42.777091+0000","last_became_peered":"2026-02-19T21:04:42.777091+0000","last_unstale":"2026-02-19T21:04:42.780127+0000","last_undegraded":"2026-02-19T21:04:42.780127+0000","last_fullsized":"2026-02-19T21:04:42.780127+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:30:11.483105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":54,"num_write":23,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":52844,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776167+0000","last_change":"2026-02-19T21:04:31.287063+0000","last_active":"2026-02-19T21:04:42.776167+0000","last_peered":"2026-02-19T21:04:42.776167+0000","last_clean":"2026-02-19T21:04:42.776167+0000","last_became_active":"2026-02-19T21:04:31.286765+0000","last_became_peered":"2026-02-19T21:04:31.286765+0000","last_unstale":"2026-02-19T21:04:42.776167+0000","last_undegraded":"2026-02-19T21:04:42.776167+0000","last_fullsized":"2026-02-19T21:04:42.776167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:15:56.935874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777541+0000","last_change":"2026-02-19T21:04:30.411559+0000","last_active":"2026-02-19T21:04:42.777541+0000","last_peered":"2026-02-19T21:04:42.777541+0000","last_clean":"2026-02-19T21:04:42.777541+0000","last_became_active":"2026-02-19T21:04:30.411317+0000","last_became_peered":"2026-02-19T21:04:30.411317+0000","last_unstale":"2026-02-19T21:04:42.777541+0000","last_undegraded":"2026-02-19T21:04:42.777541+0000","last_fullsized":"2026-02-19T21:04:42.777541+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:02:55.609906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775197+0000","last_change":"2026-02-19T21:04:31.286692+0000","last_active":"2026-02-19T21:04:42.775197+0000","last_peered":"2026-02-19T21:04:42.775197+0000","last_clean":"2026-02-19T21:04:42.775197+0000","last_became_active":"2026-02-19T21:04:31.286343+0000","last_became_peered":"2026-02-19T21:04:31.286343+0000","last_unstale":"2026-02-19T21:04:42.775197+0000","last_undegraded":"2026-02-19T21:04:42.775197+0000","last_fullsized":"2026-02-19T21:04:42.775197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:34:53.155015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778551+0000","last_change":"2026-02-19T21:04:30.409868+0000","last_active":"2026-02-19T21:04:42.778551+0000","last_peered":"2026-02-19T21:04:42.778551+0000","last_clean":"2026-02-19T21:04:42.778551+0000","last_became_active":"2026-02-19T21:04:30.409568+0000","last_became_peered":"2026-02-19T21:04:30.409568+0000","last_unstale":"2026-02-19T21:04:42.778551+0000","last_undegraded":"2026-02-19T21:04:42.778551+0000","last_fullsized":"2026-02-19T21:04:42.778551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:45:25.596378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773925+0000","last_change":"2026-02-19T21:04:31.288696+0000","last_active":"2026-02-19T21:04:41.773925+0000","last_peered":"2026-02-19T21:04:41.773925+0000","last_clean":"2026-02-19T21:04:41.773925+0000","last_became_active":"2026-02-19T21:04:31.288460+0000","last_became_peered":"2026-02-19T21:04:31.288460+0000","last_unstale":"2026-02-19T21:04:41.773925+0000","last_undegraded":"2026-02-19T21:04:41.773925+0000","last_fullsized":"2026-02-19T21:04:41.773925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:49:02.502851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775567+0000","last_change":"2026-02-19T21:04:30.409894+0000","last_active":"2026-02-19T21:04:42.775567+0000","last_peered":"2026-02-19T21:04:42.775567+0000","last_clean":"2026-02-19T21:04:42.775567+0000","last_became_active":"2026-02-19T21:04:30.409694+0000","last_became_peered":"2026-02-19T21:04:30.409694+0000","last_unstale":"2026-02-19T21:04:42.775567+0000","last_undegraded":"2026-02-19T21:04:42.775567+0000","last_fullsized":"2026-02-19T21:04:42.775567+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:44:08.909989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773691+0000","last_change":"2026-02-19T21:04:31.289106+0000","last_active":"2026-02-19T21:04:41.773691+0000","last_peered":"2026-02-19T21:04:41.773691+0000","last_clean":"2026-02-19T21:04:41.773691+0000","last_became_active":"2026-02-19T21:04:31.288889+0000","last_became_peered":"2026-02-19T21:04:31.288889+0000","last_unstale":"2026-02-19T21:04:41.773691+0000","last_undegraded":"2026-02-19T21:04:41.773691+0000","last_fullsized":"2026-02-19T21:04:41.773691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:56:11.058446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776003+0000","last_change":"2026-02-19T21:04:30.409277+0000","last_active":"2026-02-19T21:04:42.776003+0000","last_peered":"2026-02-19T21:04:42.776003+0000","last_clean":"2026-02-19T21:04:42.776003+0000","last_became_active":"2026-02-19T21:04:30.409098+0000","last_became_peered":"2026-02-19T21:04:30.409098+0000","last_unstale":"2026-02-19T21:04:42.776003+0000","last_undegraded":"2026-02-19T21:04:42.776003+0000","last_fullsized":"2026-02-19T21:04:42.776003+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:09:56.289622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778564+0000","last_change":"2026-02-19T21:04:31.289313+0000","last_active":"2026-02-19T21:04:42.778564+0000","last_peered":"2026-02-19T21:04:42.778564+0000","last_clean":"2026-02-19T21:04:42.778564+0000","last_became_active":"2026-02-19T21:04:31.288983+0000","last_became_peered":"2026-02-19T21:04:31.288983+0000","last_unstale":"2026-02-19T21:04:42.778564+0000","last_undegraded":"2026-02-19T21:04:42.778564+0000","last_fullsized":"2026-02-19T21:04:42.778564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:06:56.535103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776308+0000","last_change":"2026-02-19T21:04:30.411049+0000","last_active":"2026-02-19T21:04:42.776308+0000","last_peered":"2026-02-19T21:04:42.776308+0000","last_clean":"2026-02-19T21:04:42.776308+0000","last_became_active":"2026-02-19T21:04:30.410550+0000","last_became_peered":"2026-02-19T21:04:30.410550+0000","last_unstale":"2026-02-19T21:04:42.776308+0000","last_undegraded":"2026-02-19T21:04:42.776308+0000","last_fullsized":"2026-02-19T21:04:42.776308+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:08:50.397444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.779391+0000","last_change":"2026-02-19T21:04:42.779341+0000","last_active":"2026-02-19T21:04:42.779391+0000","last_peered":"2026-02-19T21:04:42.779391+0000","last_clean":"2026-02-19T21:04:42.779391+0000","last_became_active":"2026-02-19T21:04:42.779111+0000","last_became_peered":"2026-02-19T21:04:42.779111+0000","last_unstale":"2026-02-19T21:04:42.779391+0000","last_undegraded":"2026-02-19T21:04:42.779391+0000","last_fullsized":"2026-02-19T21:04:42.779391+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:32:10.653301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.782780+0000","last_change":"2026-02-19T21:04:42.782732+0000","last_active":"2026-02-19T21:04:42.782780+0000","last_peered":"2026-02-19T21:04:42.782780+0000","last_clean":"2026-02-19T21:04:42.782780+0000","last_became_active":"2026-02-19T21:04:42.778051+0000","last_became_peered":"2026-02-19T21:04:42.778051+0000","last_unstale":"2026-02-19T21:04:42.782780+0000","last_undegraded":"2026-02-19T21:04:42.782780+0000","last_fullsized":"2026-02-19T21:04:42.782780+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:02:23.826385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.774056+0000","last_change":"2026-02-19T21:04:31.286899+0000","last_active":"2026-02-19T21:04:41.774056+0000","last_peered":"2026-02-19T21:04:41.774056+0000","last_clean":"2026-02-19T21:04:41.774056+0000","last_became_active":"2026-02-19T21:04:31.286657+0000","last_became_peered":"2026-02-19T21:04:31.286657+0000","last_unstale":"2026-02-19T21:04:41.774056+0000","last_undegraded":"2026-02-19T21:04:41.774056+0000","last_fullsized":"2026-02-19T21:04:41.774056+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:03.670491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778820+0000","last_change":"2026-02-19T21:04:30.410815+0000","last_active":"2026-02-19T21:04:42.778820+0000","last_peered":"2026-02-19T21:04:42.778820+0000","last_clean":"2026-02-19T21:04:42.778820+0000","last_became_active":"2026-02-19T21:04:30.410567+0000","last_became_peered":"2026-02-19T21:04:30.410567+0000","last_unstale":"2026-02-19T21:04:42.778820+0000","last_undegraded":"2026-02-19T21:04:42.778820+0000","last_fullsized":"2026-02-19T21:04:42.778820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:22.307313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773870+0000","last_change":"2026-02-19T21:04:31.288226+0000","last_active":"2026-02-19T21:04:41.773870+0000","last_peered":"2026-02-19T21:04:41.773870+0000","last_clean":"2026-02-19T21:04:41.773870+0000","last_became_active":"2026-02-19T21:04:31.287964+0000","last_became_peered":"2026-02-19T21:04:31.287964+0000","last_unstale":"2026-02-19T21:04:41.773870+0000","last_undegraded":"2026-02-19T21:04:41.773870+0000","last_fullsized":"2026-02-19T21:04:41.773870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:19:01.589256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777700+0000","last_change":"2026-02-19T21:04:30.408483+0000","last_active":"2026-02-19T21:04:42.777700+0000","last_peered":"2026-02-19T21:04:42.777700+0000","last_clean":"2026-02-19T21:04:42.777700+0000","last_became_active":"2026-02-19T21:04:30.408255+0000","last_became_peered":"2026-02-19T21:04:30.408255+0000","last_unstale":"2026-02-19T21:04:42.777700+0000","last_undegraded":"2026-02-19T21:04:42.777700+0000","last_fullsized":"2026-02-19T21:04:42.777700+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:07:16.522541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773974+0000","last_change":"2026-02-19T21:04:31.287796+0000","last_active":"2026-02-19T21:04:41.773974+0000","last_peered":"2026-02-19T21:04:41.773974+0000","last_clean":"2026-02-19T21:04:41.773974+0000","last_became_active":"2026-02-19T21:04:31.287536+0000","last_became_peered":"2026-02-19T21:04:31.287536+0000","last_unstale":"2026-02-19T21:04:41.773974+0000","last_undegraded":"2026-02-19T21:04:41.773974+0000","last_fullsized":"2026-02-19T21:04:41.773974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:27:01.470441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'152","reported_seq":349,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773806+0000","last_change":"2026-02-19T21:04:12.238272+0000","last_active":"2026-02-19T21:04:41.773806+0000","last_peered":"2026-02-19T21:04:41.773806+0000","last_clean":"2026-02-19T21:04:41.773806+0000","last_became_active":"2026-02-19T21:04:12.238014+0000","last_became_peered":"2026-02-19T21:04:12.238014+0000","last_unstale":"2026-02-19T21:04:41.773806+0000","last_undegraded":"2026-02-19T21:04:41.773806+0000","last_fullsized":"2026-02-19T21:04:41.773806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:03:12.107531+0000","last_clean_scrub_stamp":"2026-02-19T21:03:12.107531+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:05:49.531734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775772+0000","last_change":"2026-02-19T21:04:30.410213+0000","last_active":"2026-02-19T21:04:42.775772+0000","last_peered":"2026-02-19T21:04:42.775772+0000","last_clean":"2026-02-19T21:04:42.775772+0000","last_became_active":"2026-02-19T21:04:30.410043+0000","last_became_peered":"2026-02-19T21:04:30.410043+0000","last_unstale":"2026-02-19T21:04:42.775772+0000","last_undegraded":"2026-02-19T21:04:42.775772+0000","last_fullsized":"2026-02-19T21:04:42.775772+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T05:34:23.716978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777473+0000","last_change":"2026-02-19T21:04:31.285502+0000","last_active":"2026-02-19T21:04:42.777473+0000","last_peered":"2026-02-19T21:04:42.777473+0000","last_clean":"2026-02-19T21:04:42.777473+0000","last_became_active":"2026-02-19T21:04:31.285248+0000","last_became_peered":"2026-02-19T21:04:31.285248+0000","last_unstale":"2026-02-19T21:04:42.777473+0000","last_undegraded":"2026-02-19T21:04:42.777473+0000","last_fullsized":"2026-02-19T21:04:42.777473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:24:54.516813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773777+0000","last_change":"2026-02-19T21:04:30.409547+0000","last_active":"2026-02-19T21:04:41.773777+0000","last_peered":"2026-02-19T21:04:41.773777+0000","last_clean":"2026-02-19T21:04:41.773777+0000","last_became_active":"2026-02-19T21:04:30.409191+0000","last_became_peered":"2026-02-19T21:04:30.409191+0000","last_unstale":"2026-02-19T21:04:41.773777+0000","last_undegraded":"2026-02-19T21:04:41.773777+0000","last_fullsized":"2026-02-19T21:04:41.773777+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:14:53.157004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775028+0000","last_change":"2026-02-19T21:04:31.287071+0000","last_active":"2026-02-19T21:04:42.775028+0000","last_peered":"2026-02-19T21:04:42.775028+0000","last_clean":"2026-02-19T21:04:42.775028+0000","last_became_active":"2026-02-19T21:04:31.286826+0000","last_became_peered":"2026-02-19T21:04:31.286826+0000","last_unstale":"2026-02-19T21:04:42.775028+0000","last_undegraded":"2026-02-19T21:04:42.775028+0000","last_fullsized":"2026-02-19T21:04:42.775028+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:26:22.218657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":32,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775282+0000","last_change":"2026-02-19T21:04:30.407561+0000","last_active":"2026-02-19T21:04:42.775282+0000","last_peered":"2026-02-19T21:04:42.775282+0000","last_clean":"2026-02-19T21:04:42.775282+0000","last_became_active":"2026-02-19T21:04:30.407338+0000","last_became_peered":"2026-02-19T21:04:30.407338+0000","last_unstale":"2026-02-19T21:04:42.775282+0000","last_undegraded":"2026-02-19T21:04:42.775282+0000","last_fullsized":"2026-02-19T21:04:42.775282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:54:33.062163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778802+0000","last_change":"2026-02-19T21:04:31.289132+0000","last_active":"2026-02-19T21:04:42.778802+0000","last_peered":"2026-02-19T21:04:42.778802+0000","last_clean":"2026-02-19T21:04:42.778802+0000","last_became_active":"2026-02-19T21:04:31.288397+0000","last_became_peered":"2026-02-19T21:04:31.288397+0000","last_unstale":"2026-02-19T21:04:42.778802+0000","last_undegraded":"2026-02-19T21:04:42.778802+0000","last_fullsized":"2026-02-19T21:04:42.778802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:06:10.359363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773839+0000","last_change":"2026-02-19T21:04:30.409909+0000","last_active":"2026-02-19T21:04:41.773839+0000","last_peered":"2026-02-19T21:04:41.773839+0000","last_clean":"2026-02-19T21:04:41.773839+0000","last_became_active":"2026-02-19T21:04:30.409595+0000","last_became_peered":"2026-02-19T21:04:30.409595+0000","last_unstale":"2026-02-19T21:04:41.773839+0000","last_undegraded":"2026-02-19T21:04:41.773839+0000","last_fullsized":"2026-02-19T21:04:41.773839+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:34:26.108002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.806975+0000","last_change":"2026-02-19T21:04:42.806920+0000","last_active":"2026-02-19T21:04:42.806975+0000","last_peered":"2026-02-19T21:04:42.806975+0000","last_clean":"2026-02-19T21:04:42.806975+0000","last_became_active":"2026-02-19T21:04:42.806748+0000","last_became_peered":"2026-02-19T21:04:42.806748+0000","last_unstale":"2026-02-19T21:04:42.806975+0000","last_undegraded":"2026-02-19T21:04:42.806975+0000","last_fullsized":"2026-02-19T21:04:42.806975+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:15:39.627995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775077+0000","last_change":"2026-02-19T21:04:30.408729+0000","last_active":"2026-02-19T21:04:42.775077+0000","last_peered":"2026-02-19T21:04:42.775077+0000","last_clean":"2026-02-19T21:04:42.775077+0000","last_became_active":"2026-02-19T21:04:30.408489+0000","last_became_peered":"2026-02-19T21:04:30.408489+0000","last_unstale":"2026-02-19T21:04:42.775077+0000","last_undegraded":"2026-02-19T21:04:42.775077+0000","last_fullsized":"2026-02-19T21:04:42.775077+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:38:32.753162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775582+0000","last_change":"2026-02-19T21:04:31.282620+0000","last_active":"2026-02-19T21:04:42.775582+0000","last_peered":"2026-02-19T21:04:42.775582+0000","last_clean":"2026-02-19T21:04:42.775582+0000","last_became_active":"2026-02-19T21:04:31.282207+0000","last_became_peered":"2026-02-19T21:04:31.282207+0000","last_unstale":"2026-02-19T21:04:42.775582+0000","last_undegraded":"2026-02-19T21:04:42.775582+0000","last_fullsized":"2026-02-19T21:04:42.775582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:22:05.657414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776287+0000","last_change":"2026-02-19T21:04:30.412136+0000","last_active":"2026-02-19T21:04:42.776287+0000","last_peered":"2026-02-19T21:04:42.776287+0000","last_clean":"2026-02-19T21:04:42.776287+0000","last_became_active":"2026-02-19T21:04:30.412001+0000","last_became_peered":"2026-02-19T21:04:30.412001+0000","last_unstale":"2026-02-19T21:04:42.776287+0000","last_undegraded":"2026-02-19T21:04:42.776287+0000","last_fullsized":"2026-02-19T21:04:42.776287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:27:51.577913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775435+0000","last_change":"2026-02-19T21:04:31.286103+0000","last_active":"2026-02-19T21:04:42.775435+0000","last_peered":"2026-02-19T21:04:42.775435+0000","last_clean":"2026-02-19T21:04:42.775435+0000","last_became_active":"2026-02-19T21:04:31.285858+0000","last_became_peered":"2026-02-19T21:04:31.285858+0000","last_unstale":"2026-02-19T21:04:42.775435+0000","last_undegraded":"2026-02-19T21:04:42.775435+0000","last_fullsized":"2026-02-19T21:04:42.775435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:32:34.696574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"75'6","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.781483+0000","last_change":"2026-02-19T21:04:42.781437+0000","last_active":"2026-02-19T21:04:42.781483+0000","last_peered":"2026-02-19T21:04:42.781483+0000","last_clean":"2026-02-19T21:04:42.781483+0000","last_became_active":"2026-02-19T21:04:42.778147+0000","last_became_peered":"2026-02-19T21:04:42.778147+0000","last_unstale":"2026-02-19T21:04:42.781483+0000","last_undegraded":"2026-02-19T21:04:42.781483+0000","last_fullsized":"2026-02-19T21:04:42.781483+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T08:17:33.551168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778053+0000","last_change":"2026-02-19T21:04:31.286348+0000","last_active":"2026-02-19T21:04:42.778053+0000","last_peered":"2026-02-19T21:04:42.778053+0000","last_clean":"2026-02-19T21:04:42.778053+0000","last_became_active":"2026-02-19T21:04:31.286157+0000","last_became_peered":"2026-02-19T21:04:31.286157+0000","last_unstale":"2026-02-19T21:04:42.778053+0000","last_undegraded":"2026-02-19T21:04:42.778053+0000","last_fullsized":"2026-02-19T21:04:42.778053+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T22:57:02.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775724+0000","last_change":"2026-02-19T21:04:30.409263+0000","last_active":"2026-02-19T21:04:42.775724+0000","last_peered":"2026-02-19T21:04:42.775724+0000","last_clean":"2026-02-19T21:04:42.775724+0000","last_became_active":"2026-02-19T21:04:30.408394+0000","last_became_peered":"2026-02-19T21:04:30.408394+0000","last_unstale":"2026-02-19T21:04:42.775724+0000","last_undegraded":"2026-02-19T21:04:42.775724+0000","last_fullsized":"2026-02-19T21:04:42.775724+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:15:30.665040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773889+0000","last_change":"2026-02-19T21:04:31.287859+0000","last_active":"2026-02-19T21:04:41.773889+0000","last_peered":"2026-02-19T21:04:41.773889+0000","last_clean":"2026-02-19T21:04:41.773889+0000","last_became_active":"2026-02-19T21:04:31.287687+0000","last_became_peered":"2026-02-19T21:04:31.287687+0000","last_unstale":"2026-02-19T21:04:41.773889+0000","last_undegraded":"2026-02-19T21:04:41.773889+0000","last_fullsized":"2026-02-19T21:04:41.773889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:26:18.995690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776593+0000","last_change":"2026-02-19T21:04:30.410334+0000","last_active":"2026-02-19T21:04:42.776593+0000","last_peered":"2026-02-19T21:04:42.776593+0000","last_clean":"2026-02-19T21:04:42.776593+0000","last_became_active":"2026-02-19T21:04:30.409928+0000","last_became_peered":"2026-02-19T21:04:30.409928+0000","last_unstale":"2026-02-19T21:04:42.776593+0000","last_undegraded":"2026-02-19T21:04:42.776593+0000","last_fullsized":"2026-02-19T21:04:42.776593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:21:33.041734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776017+0000","last_change":"2026-02-19T21:04:31.286369+0000","last_active":"2026-02-19T21:04:42.776017+0000","last_peered":"2026-02-19T21:04:42.776017+0000","last_clean":"2026-02-19T21:04:42.776017+0000","last_became_active":"2026-02-19T21:04:31.285908+0000","last_became_peered":"2026-02-19T21:04:31.285908+0000","last_unstale":"2026-02-19T21:04:42.776017+0000","last_undegraded":"2026-02-19T21:04:42.776017+0000","last_fullsized":"2026-02-19T21:04:42.776017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:32:23.440567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777496+0000","last_change":"2026-02-19T21:04:30.410110+0000","last_active":"2026-02-19T21:04:42.777496+0000","last_peered":"2026-02-19T21:04:42.777496+0000","last_clean":"2026-02-19T21:04:42.777496+0000","last_became_active":"2026-02-19T21:04:30.409864+0000","last_became_peered":"2026-02-19T21:04:30.409864+0000","last_unstale":"2026-02-19T21:04:42.777496+0000","last_undegraded":"2026-02-19T21:04:42.777496+0000","last_fullsized":"2026-02-19T21:04:42.777496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T06:58:06.526168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777103+0000","last_change":"2026-02-19T21:04:31.287332+0000","last_active":"2026-02-19T21:04:42.777103+0000","last_peered":"2026-02-19T21:04:42.777103+0000","last_clean":"2026-02-19T21:04:42.777103+0000","last_became_active":"2026-02-19T21:04:31.287112+0000","last_became_peered":"2026-02-19T21:04:31.287112+0000","last_unstale":"2026-02-19T21:04:42.777103+0000","last_undegraded":"2026-02-19T21:04:42.777103+0000","last_fullsized":"2026-02-19T21:04:42.777103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T03:06:33.375075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777392+0000","last_change":"2026-02-19T21:04:30.410600+0000","last_active":"2026-02-19T21:04:42.777392+0000","last_peered":"2026-02-19T21:04:42.777392+0000","last_clean":"2026-02-19T21:04:42.777392+0000","last_became_active":"2026-02-19T21:04:30.410268+0000","last_became_peered":"2026-02-19T21:04:30.410268+0000","last_unstale":"2026-02-19T21:04:42.777392+0000","last_undegraded":"2026-02-19T21:04:42.777392+0000","last_fullsized":"2026-02-19T21:04:42.777392+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T02:41:28.323119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777507+0000","last_change":"2026-02-19T21:04:31.284350+0000","last_active":"2026-02-19T21:04:42.777507+0000","last_peered":"2026-02-19T21:04:42.777507+0000","last_clean":"2026-02-19T21:04:42.777507+0000","last_became_active":"2026-02-19T21:04:31.284130+0000","last_became_peered":"2026-02-19T21:04:31.284130+0000","last_unstale":"2026-02-19T21:04:42.777507+0000","last_undegraded":"2026-02-19T21:04:42.777507+0000","last_fullsized":"2026-02-19T21:04:42.777507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:18:19.362792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776084+0000","last_change":"2026-02-19T21:04:30.411333+0000","last_active":"2026-02-19T21:04:42.776084+0000","last_peered":"2026-02-19T21:04:42.776084+0000","last_clean":"2026-02-19T21:04:42.776084+0000","last_became_active":"2026-02-19T21:04:30.411052+0000","last_became_peered":"2026-02-19T21:04:30.411052+0000","last_unstale":"2026-02-19T21:04:42.776084+0000","last_undegraded":"2026-02-19T21:04:42.776084+0000","last_fullsized":"2026-02-19T21:04:42.776084+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:13:12.351852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773834+0000","last_change":"2026-02-19T21:04:31.287054+0000","last_active":"2026-02-19T21:04:41.773834+0000","last_peered":"2026-02-19T21:04:41.773834+0000","last_clean":"2026-02-19T21:04:41.773834+0000","last_became_active":"2026-02-19T21:04:31.286548+0000","last_became_peered":"2026-02-19T21:04:31.286548+0000","last_unstale":"2026-02-19T21:04:41.773834+0000","last_undegraded":"2026-02-19T21:04:41.773834+0000","last_fullsized":"2026-02-19T21:04:41.773834+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T23:47:15.932826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.778708+0000","last_change":"2026-02-19T21:04:31.289365+0000","last_active":"2026-02-19T21:04:42.778708+0000","last_peered":"2026-02-19T21:04:42.778708+0000","last_clean":"2026-02-19T21:04:42.778708+0000","last_became_active":"2026-02-19T21:04:31.288986+0000","last_became_peered":"2026-02-19T21:04:31.288986+0000","last_unstale":"2026-02-19T21:04:42.778708+0000","last_undegraded":"2026-02-19T21:04:42.778708+0000","last_fullsized":"2026-02-19T21:04:42.778708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:55:08.268972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.785356+0000","last_change":"2026-02-19T21:04:42.785184+0000","last_active":"2026-02-19T21:04:42.785356+0000","last_peered":"2026-02-19T21:04:42.785356+0000","last_clean":"2026-02-19T21:04:42.785356+0000","last_became_active":"2026-02-19T21:04:42.779370+0000","last_became_peered":"2026-02-19T21:04:42.779370+0000","last_unstale":"2026-02-19T21:04:42.785356+0000","last_undegraded":"2026-02-19T21:04:42.785356+0000","last_fullsized":"2026-02-19T21:04:42.785356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:21:07.704927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776884+0000","last_change":"2026-02-19T21:04:31.287464+0000","last_active":"2026-02-19T21:04:42.776884+0000","last_peered":"2026-02-19T21:04:42.776884+0000","last_clean":"2026-02-19T21:04:42.776884+0000","last_became_active":"2026-02-19T21:04:31.287159+0000","last_became_peered":"2026-02-19T21:04:31.287159+0000","last_unstale":"2026-02-19T21:04:42.776884+0000","last_undegraded":"2026-02-19T21:04:42.776884+0000","last_fullsized":"2026-02-19T21:04:42.776884+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:30:26.608871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.776170+0000","last_change":"2026-02-19T21:04:30.411307+0000","last_active":"2026-02-19T21:04:42.776170+0000","last_peered":"2026-02-19T21:04:42.776170+0000","last_clean":"2026-02-19T21:04:42.776170+0000","last_became_active":"2026-02-19T21:04:30.411044+0000","last_became_peered":"2026-02-19T21:04:30.411044+0000","last_unstale":"2026-02-19T21:04:42.776170+0000","last_undegraded":"2026-02-19T21:04:42.776170+0000","last_fullsized":"2026-02-19T21:04:42.776170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T04:39:22.516979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-19T21:04:41.773860+0000","last_change":"2026-02-19T21:04:31.286139+0000","last_active":"2026-02-19T21:04:41.773860+0000","last_peered":"2026-02-19T21:04:41.773860+0000","last_clean":"2026-02-19T21:04:41.773860+0000","last_became_active":"2026-02-19T21:04:31.285718+0000","last_became_peered":"2026-02-19T21:04:31.285718+0000","last_unstale":"2026-02-19T21:04:41.773860+0000","last_undegraded":"2026-02-19T21:04:41.773860+0000","last_fullsized":"2026-02-19T21:04:41.773860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T00:15:18.002138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777943+0000","last_change":"2026-02-19T21:04:30.410568+0000","last_active":"2026-02-19T21:04:42.777943+0000","last_peered":"2026-02-19T21:04:42.777943+0000","last_clean":"2026-02-19T21:04:42.777943+0000","last_became_active":"2026-02-19T21:04:30.410323+0000","last_became_peered":"2026-02-19T21:04:30.410323+0000","last_unstale":"2026-02-19T21:04:42.777943+0000","last_undegraded":"2026-02-19T21:04:42.777943+0000","last_fullsized":"2026-02-19T21:04:42.777943+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T01:14:30.270933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.777889+0000","last_change":"2026-02-19T21:04:31.286019+0000","last_active":"2026-02-19T21:04:42.777889+0000","last_peered":"2026-02-19T21:04:42.777889+0000","last_clean":"2026-02-19T21:04:42.777889+0000","last_became_active":"2026-02-19T21:04:31.285608+0000","last_became_peered":"2026-02-19T21:04:31.285608+0000","last_unstale":"2026-02-19T21:04:42.777889+0000","last_undegraded":"2026-02-19T21:04:42.777889+0000","last_fullsized":"2026-02-19T21:04:42.777889+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:30.400817+0000","last_clean_scrub_stamp":"2026-02-19T21:04:30.400817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-21T07:34:30.034673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2026-02-19T21:04:42.775542+0000","last_change":"2026-02-19T21:04:30.409329+0000","last_active":"2026-02-19T21:04:42.775542+0000","last_peered":"2026-02-19T21:04:42.775542+0000","last_clean":"2026-02-19T21:04:42.775542+0000","last_became_active":"2026-02-19T21:04:30.408892+0000","last_became_peered":"2026-02-19T21:04:30.408892+0000","last_unstale":"2026-02-19T21:04:42.775542+0000","last_undegraded":"2026-02-19T21:04:42.775542+0000","last_fullsized":"2026-02-19T21:04:42.775542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-19T21:04:29.396991+0000","last_clean_scrub_stamp":"2026-02-19T21:04:29.396991+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T21:16:52.316860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":56930,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":65,"num_read_kb":88,"num_write":146,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":52844,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":170790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":176795,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710727,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27772,"kb_used_data":808,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975428,"statfs":{"total":751619276800,"available":751590838272,"internally_reserved":0,"allocated":827392,"data_stored":403563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9792,"internal_metadata":27580864},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939657,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28456,"kb_used_data":1492,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733974744,"statfs":{"total":751619276800,"available":751590137856,"internally_reserved":0,"allocated":1527808,"data_stored":1056329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28798,"internal_metadata":27561858},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070475,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":24,"kb_used_meta":26919,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":403799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25347,"internal_metadata":27565309},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299405,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":412160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21936,"internal_metadata":27568720},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528333,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28368,"kb_used_data":1404,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733974832,"statfs":{"total":751619276800,"available":751590227968,"internally_reserved":0,"allocated":1437696,"data_stored":995668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33900,"internal_metadata":27556756},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":27,"kb_used_meta":26916,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":411607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28371,"internal_metadata":27562285},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888080,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28380,"kb_used_data":1416,"kb_used_omap":20,"kb_used_meta":26923,"kb_avail":733974820,"statfs":{"total":751619276800,"available":751590215680,"internally_reserved":0,"allocated":1449984,"data_stored":995352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20482,"internal_metadata":27570174},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018898,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":39,"kb_used_meta":26904,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":464888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40797,"internal_metadata":27549859},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247828,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27792,"kb_used_data":828,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975408,"statfs":{"total":751619276800,"available":751590817792,"internally_reserved":0,"allocated":847872,"data_stored":403477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47469,"internal_metadata":27543187},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476758,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27864,"kb_used_data":840,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975336,"statfs":{"total":751619276800,"available":751590744064,"internally_reserved":0,"allocated":860160,"data_stored":413182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49824,"internal_metadata":27540832},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607574,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27828,"kb_used_data":864,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975372,"statfs":{"total":751619276800,"available":751590780928,"internally_reserved":0,"allocated":884736,"data_stored":455803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44971,"internal_metadata":27545685},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":47,"kb_used_meta":26896,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":404481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49081,"internal_metadata":27541575},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47346,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":52844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1896,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13758,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19456,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17429,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5309,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6303,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20607,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11216,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16324,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12919,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4232,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-19T21:04:45.753 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-19T21:04:45.754 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-19T21:04:45.754 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-19T21:04:45.754 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:04:45.906 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/440742488' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1776369788' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3285836060' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/956828935' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2480326753' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1835007259' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-19T21:04:45.955 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2102621420' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-19T21:04:45.956 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3299133163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-19T21:04:45.956 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: pgmap v184: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:45.956 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:45 trial090 ceph-mon[31759]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/2718040970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 msgr2=0x7fbb5410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/2718040970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5410f5d0 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=1374636682559063395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb400099a0 tx=0x7fbb4002ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/2718040970 shutdown_connections 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/2718040970 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbb54115410 0x7fbb54175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/2718040970 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbb5410fbf0 0x7fbb54114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/2718040970 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5410f5d0 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=1374636682559063395 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/2718040970 >> 10.20.193.90:0/2718040970 conn(0x7fbb540ecac0 msgr2=0x7fbb5410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/2718040970 shutdown_connections 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/2718040970 wait complete. 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 Processor -- start 2026-02-19T21:04:46.027 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.026+0000 7fbb5a25c6c0 1 -- start start 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5411d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbb54115410 0x7fbb5411d860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbb54122c20 0x7fbb541230c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54123630 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb541237a0 con 0x7fbb54115410 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb54123960 con 0x7fbb54122c20 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5411d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5411d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43254/0 (socket says 10.20.193.90:43254) 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 -- 10.20.193.90:0/3216618741 learned_addr learned my addr 10.20.193.90:0/3216618741 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 -- 10.20.193.90:0/3216618741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbb54122c20 msgr2=0x7fbb541230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbb54122c20 0x7fbb541230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 -- 10.20.193.90:0/3216618741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbb54115410 msgr2=0x7fbb5411d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbb54115410 0x7fbb5411d860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 -- 10.20.193.90:0/3216618741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb40009590 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb537fe6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5411d320 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb4002f230 tx=0x7fbb4002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb40002ba0 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fbb40002d00 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbb400372f0 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb54163db0 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb541641e0 con 0x7fbb5410f200 2026-02-19T21:04:46.028 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.027+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb541104d0 con 0x7fbb5410f200 2026-02-19T21:04:46.029 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.029+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fbb400078d0 con 0x7fbb5410f200 2026-02-19T21:04:46.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.029+0000 7fbb50ff96c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbb280b5760 0x7fbb280d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:46.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.029+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fbb40107ed0 con 0x7fbb5410f200 2026-02-19T21:04:46.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.029+0000 7fbb52ffd6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbb280b5760 0x7fbb280d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:46.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.029+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbb400ca760 con 0x7fbb5410f200 2026-02-19T21:04:46.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.030+0000 7fbb52ffd6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbb280b5760 0x7fbb280d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb54123cb0 tx=0x7fbb44009410 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/440742488' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1776369788' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3285836060' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/956828935' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2480326753' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1835007259' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2102621420' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3299133163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: pgmap v184: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:46.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:45 trial105 ceph-mon[33883]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:46.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.144+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbb5410f5d0 con 0x7fbb5410f200 2026-02-19T21:04:46.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.144+0000 7fbb50ff96c0 1 -- 10.20.193.90:0/3216618741 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbb400cd910 con 0x7fbb5410f200 2026-02-19T21:04:46.146 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:46.146 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:04:46.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbb280b5760 msgr2=0x7fbb280d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:46.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbb280b5760 0x7fbb280d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb54123cb0 tx=0x7fbb44009410 comp rx=0 tx=0).stop 2026-02-19T21:04:46.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 msgr2=0x7fbb5411d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:46.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5411d320 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb4002f230 tx=0x7fbb4002fd40 comp rx=0 tx=0).stop 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 shutdown_connections 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fbb280b5760 0x7fbb280d5c10 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fbb54122c20 0x7fbb541230c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fbb54115410 0x7fbb5411d860 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 --2- 10.20.193.90:0/3216618741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fbb5410f200 0x7fbb5411d320 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 >> 10.20.193.90:0/3216618741 conn(0x7fbb540ecac0 msgr2=0x7fbb5410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 shutdown_connections 2026-02-19T21:04:46.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:46.145+0000 7fbb5a25c6c0 1 -- 10.20.193.90:0/3216618741 wait complete. 2026-02-19T21:04:46.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/440742488' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-19T21:04:46.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1776369788' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-19T21:04:46.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3285836060' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-19T21:04:46.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/956828935' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-19T21:04:46.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2480326753' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-19T21:04:46.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1835007259' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-19T21:04:46.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2102621420' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-19T21:04:46.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3299133163' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-19T21:04:46.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: pgmap v184: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 17 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:46.267 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:45 trial175 ceph-mon[34116]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:47.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:46 trial105 ceph-mon[33883]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:47.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:46 trial105 ceph-mon[33883]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2026-02-19T21:04:47.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:46 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3216618741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:47.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:46 trial090 ceph-mon[31759]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:47.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:46 trial090 ceph-mon[31759]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2026-02-19T21:04:47.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:46 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3216618741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:47.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:46 trial175 ceph-mon[34116]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-19T21:04:47.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:46 trial175 ceph-mon[34116]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2026-02-19T21:04:47.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:46 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3216618741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:48.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:47 trial105 ceph-mon[33883]: pgmap v185: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 5.7 KiB/s wr, 10 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:48.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:47 trial090 ceph-mon[31759]: pgmap v185: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 5.7 KiB/s wr, 10 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:48.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:47 trial175 ceph-mon[34116]: pgmap v185: 97 pgs: 97 active+clean; 632 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 5.7 KiB/s wr, 10 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:49.184 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:04:49.308 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/1167105952 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010fbf0 msgr2=0x7f18b0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/1167105952 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010fbf0 0x7f18b0114c30 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=7265761435788417879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a40099a0 tx=0x7f18a402ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/1167105952 shutdown_connections 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/1167105952 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f18b0115410 0x7f18b0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/1167105952 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010fbf0 0x7f18b0114c30 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=7265761435788417879 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/1167105952 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f18b010f200 0x7f18b010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/1167105952 >> 10.20.193.90:0/1167105952 conn(0x7f18b00eca60 msgr2=0x7f18b010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/1167105952 shutdown_connections 2026-02-19T21:04:49.417 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.415+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/1167105952 wait complete. 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 Processor -- start 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 -- start start 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 0x7f18b00f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f18b0115410 0x7f18b0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f18b00f5240 0x7f18b00fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00f5930 con 0x7f18b010f200 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00faa50 con 0x7f18b0115410 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18b00fac10 con 0x7f18b00f5240 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 0x7f18b00f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 0x7f18b00f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43278/0 (socket says 10.20.193.90:43278) 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 -- 10.20.193.90:0/3452002074 learned_addr learned my addr 10.20.193.90:0/3452002074 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b593d6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f18b0115410 0x7f18b0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b693f6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f18b00f5240 0x7f18b00fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 -- 10.20.193.90:0/3452002074 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f18b00f5240 msgr2=0x7f18b00fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f18b00f5240 0x7f18b00fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 -- 10.20.193.90:0/3452002074 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f18b0115410 msgr2=0x7f18b0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f18b0115410 0x7f18b0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 -- 10.20.193.90:0/3452002074 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a4009590 con 0x7f18b010f200 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b613e6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 0x7f18b00f4c10 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a000b710 tx=0x7f18a000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18a0004250 con 0x7f18b010f200 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b00faef0 con 0x7f18b010f200 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f18a0002d80 con 0x7f18b010f200 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18a000cda0 con 0x7f18b010f200 2026-02-19T21:04:49.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.416+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b00fb680 con 0x7f18b010f200 2026-02-19T21:04:49.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.417+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b01104d0 con 0x7f18b010f200 2026-02-19T21:04:49.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.418+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f18a00028c0 con 0x7f18b010f200 2026-02-19T21:04:49.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.419+0000 7f18977fe6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f188c0b5760 0x7f188c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:49.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.419+0000 7f18b593d6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f188c0b5760 0x7f188c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:49.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.419+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f18a00e3d50 con 0x7f18b010f200 2026-02-19T21:04:49.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.419+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18a00e4240 con 0x7f18b010f200 2026-02-19T21:04:49.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.419+0000 7f18b593d6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f188c0b5760 0x7f188c0d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a4005b40 tx=0x7f18a40092a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:49.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.533+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f18b010f5d0 con 0x7f18b010f200 2026-02-19T21:04:49.536 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.533+0000 7f18977fe6c0 1 -- 10.20.193.90:0/3452002074 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f18a00a65e0 con 0x7f18b010f200 2026-02-19T21:04:49.562 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:49.562 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:04:49.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.534+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f188c0b5760 msgr2=0x7f188c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:49.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.534+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f188c0b5760 0x7f188c0d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a4005b40 tx=0x7f18a40092a0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 msgr2=0x7f18b00f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 0x7f18b00f4c10 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18a000b710 tx=0x7f18a000bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 shutdown_connections 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f188c0b5760 0x7f188c0d5c10 unknown :-1 s=CLOSED pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f18b00f5240 0x7f18b00fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f18b0115410 0x7f18b0175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 --2- 10.20.193.90:0/3452002074 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f18b010f200 0x7f18b00f4c10 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 >> 10.20.193.90:0/3452002074 conn(0x7f18b00eca60 msgr2=0x7f18b010d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 shutdown_connections 2026-02-19T21:04:49.564 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:49.535+0000 7f18b83cd6c0 1 -- 10.20.193.90:0/3452002074 wait complete. 2026-02-19T21:04:50.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:49 trial175 ceph-mon[34116]: pgmap v186: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 10 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:50.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:49 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3452002074' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:50.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:49 trial105 ceph-mon[33883]: pgmap v186: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 10 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:50.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:49 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3452002074' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:50.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:49 trial090 ceph-mon[31759]: pgmap v186: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 10 op/s; 6.4 KiB/s, 1 keys/s, 1 objects/s recovering 2026-02-19T21:04:50.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:49 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3452002074' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:52.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:51 trial175 ceph-mon[34116]: pgmap v187: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 5.3 KiB/s wr, 7 op/s; 5.7 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:52.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:51 trial105 ceph-mon[33883]: pgmap v187: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 5.3 KiB/s wr, 7 op/s; 5.7 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:52.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:51 trial090 ceph-mon[31759]: pgmap v187: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 7.0 KiB/s rd, 5.3 KiB/s wr, 7 op/s; 5.7 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:52.575 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:04:52.699 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:52.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/907101738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010fbf0 msgr2=0x7f2f50114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:52.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/907101738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010fbf0 0x7f2f50114c30 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=15160538834724331139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f380099a0 tx=0x7f2f3802ed20 comp rx=0 tx=0).stop 2026-02-19T21:04:52.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/907101738 shutdown_connections 2026-02-19T21:04:52.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/907101738 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2f50115410 0x7f2f50175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/907101738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f5010fbf0 0x7f2f50114c30 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=15160538834724331139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/907101738 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2f5010f200 0x7f2f5010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/907101738 >> 10.20.193.90:0/907101738 conn(0x7f2f500eca60 msgr2=0x7f2f5010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/907101738 shutdown_connections 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/907101738 wait complete. 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 Processor -- start 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- start start 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2f5010f200 0x7f2f500f4b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2f50115410 0x7f2f50175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 0x7f2f500fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500f58b0 con 0x7f2f500f51c0 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500fa9d0 con 0x7f2f5010f200 2026-02-19T21:04:52.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f54e7d6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2f500fab90 con 0x7f2f50115410 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4ed766c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 0x7f2f500fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4ed766c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 0x7f2f500fa490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43300/0 (socket says 10.20.193.90:43300) 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4ed766c0 1 -- 10.20.193.90:0/2587109448 learned_addr learned my addr 10.20.193.90:0/2587109448 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4e5756c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2f5010f200 0x7f2f500f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4dd746c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2f50115410 0x7f2f50175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4ed766c0 1 -- 10.20.193.90:0/2587109448 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2f50115410 msgr2=0x7f2f50175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.806+0000 7f2f4ed766c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2f50115410 0x7f2f50175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f4ed766c0 1 -- 10.20.193.90:0/2587109448 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2f5010f200 msgr2=0x7f2f500f4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f4ed766c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2f5010f200 0x7f2f500f4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f4ed766c0 1 -- 10.20.193.90:0/2587109448 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f38009590 con 0x7f2f500f51c0 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f4ed766c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 0x7f2f500fa490 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f4000c6c0 tx=0x7f2f4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:52.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f40003c40 con 0x7f2f500f51c0 2026-02-19T21:04:52.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2f4000a030 con 0x7f2f500f51c0 2026-02-19T21:04:52.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2f4000db70 con 0x7f2f500f51c0 2026-02-19T21:04:52.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f500fae70 con 0x7f2f500f51c0 2026-02-19T21:04:52.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f500fb600 con 0x7f2f500f51c0 2026-02-19T21:04:52.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.807+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f501104d0 con 0x7f2f500f51c0 2026-02-19T21:04:52.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.808+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f2f4000dd20 con 0x7f2f500f51c0 2026-02-19T21:04:52.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.809+0000 7f2f377fe6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2f280b5760 0x7f2f280d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:52.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.809+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2f400e4b60 con 0x7f2f500f51c0 2026-02-19T21:04:52.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.809+0000 7f2f4e5756c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2f280b5760 0x7f2f280d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:52.815 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.809+0000 7f2f4e5756c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2f280b5760 0x7f2f280d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f44006b60 tx=0x7f2f44006af0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:52.816 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.809+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2f400a73b0 con 0x7f2f500f51c0 2026-02-19T21:04:52.926 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.924+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2f500f5d10 con 0x7f2f500f51c0 2026-02-19T21:04:52.926 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.924+0000 7f2f377fe6c0 1 -- 10.20.193.90:0/2587109448 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2f400aa560 con 0x7f2f500f51c0 2026-02-19T21:04:52.927 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:52.927 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2f280b5760 msgr2=0x7f2f280d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2f280b5760 0x7f2f280d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f44006b60 tx=0x7f2f44006af0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 msgr2=0x7f2f500fa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 0x7f2f500fa490 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f4000c6c0 tx=0x7f2f4000cb90 comp rx=0 tx=0).stop 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 shutdown_connections 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2f280b5760 0x7f2f280d5c10 unknown :-1 s=CLOSED pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2f500f51c0 0x7f2f500fa490 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2f50115410 0x7f2f50175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 --2- 10.20.193.90:0/2587109448 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2f5010f200 0x7f2f500f4b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:52.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 >> 10.20.193.90:0/2587109448 conn(0x7f2f500eca60 msgr2=0x7f2f5010d800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:52.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 shutdown_connections 2026-02-19T21:04:52.929 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:52.925+0000 7f2f54e7d6c0 1 -- 10.20.193.90:0/2587109448 wait complete. 2026-02-19T21:04:53.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:52 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2587109448' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:53.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:52 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2587109448' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:53.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:52 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2587109448' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:54.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:53 trial175 ceph-mon[34116]: pgmap v188: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s; 5.1 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:54.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:53 trial105 ceph-mon[33883]: pgmap v188: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s; 5.1 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:54.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:53 trial090 ceph-mon[31759]: pgmap v188: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s; 5.1 KiB/s, 1 keys/s, 0 objects/s recovering 2026-02-19T21:04:55.967 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:04:56.095 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:56.209 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:55 trial090 ceph-mon[31759]: pgmap v189: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2170211312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe770115410 msgr2=0x7fe770175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2170211312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe770115410 0x7fe770175db0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=6135162216447285055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76c00aa70 tx=0x7fe76c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2170211312 shutdown_connections 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2170211312 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe770115410 0x7fe770175db0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=6135162216447285055 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2170211312 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe77010fbf0 0x7fe770114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2170211312 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe77010f200 0x7fe77010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2170211312 >> 10.20.193.90:0/2170211312 conn(0x7fe7700eca60 msgr2=0x7fe77010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2170211312 shutdown_connections 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2170211312 wait complete. 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 Processor -- start 2026-02-19T21:04:56.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- start start 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 0x7fe77011d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe770115410 0x7fe77011d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe770122b10 0x7fe770122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe770123520 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe770123690 con 0x7fe770122b10 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.210+0000 7fe777cb06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe770123850 con 0x7fe770115410 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 0x7fe77011d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 0x7fe77011d210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50832/0 (socket says 10.20.193.90:50832) 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 -- 10.20.193.90:0/2890144760 learned_addr learned my addr 10.20.193.90:0/2890144760 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe7752246c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe770115410 0x7fe77011d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe7762266c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe770122b10 0x7fe770122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 -- 10.20.193.90:0/2890144760 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe770115410 msgr2=0x7fe77011d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe770115410 0x7fe77011d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 -- 10.20.193.90:0/2890144760 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe770122b10 msgr2=0x7fe770122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe770122b10 0x7fe770122fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 -- 10.20.193.90:0/2890144760 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76c00a660 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe775a256c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 0x7fe77011d210 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76000b710 tx=0x7fe76000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe760004250 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe760002d80 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe76000cdc0 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe770163d00 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe770164190 con 0x7fe77010f200 2026-02-19T21:04:56.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.211+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7701104d0 con 0x7fe77010f200 2026-02-19T21:04:56.214 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.213+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fe7600028c0 con 0x7fe77010f200 2026-02-19T21:04:56.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.213+0000 7fe75effd6c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe74c0b56e0 0x7fe74c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:56.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.214+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fe7600e3eb0 con 0x7fe77010f200 2026-02-19T21:04:56.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.214+0000 7fe7752246c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe74c0b56e0 0x7fe74c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:56.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.214+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe7600a6740 con 0x7fe77010f200 2026-02-19T21:04:56.215 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.214+0000 7fe7752246c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe74c0b56e0 0x7fe74c0d5b90 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764005980 tx=0x7fe764005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:56.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:55 trial175 ceph-mon[34116]: pgmap v189: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2026-02-19T21:04:56.329 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.328+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe77010f5d0 con 0x7fe77010f200 2026-02-19T21:04:56.329 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.328+0000 7fe75effd6c0 1 -- 10.20.193.90:0/2890144760 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe7600a98f0 con 0x7fe77010f200 2026-02-19T21:04:56.330 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:56.330 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:04:56.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe74c0b56e0 msgr2=0x7fe74c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:56.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe74c0b56e0 0x7fe74c0d5b90 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe764005980 tx=0x7fe764005910 comp rx=0 tx=0).stop 2026-02-19T21:04:56.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 msgr2=0x7fe77011d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:56.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 0x7fe77011d210 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe76000b710 tx=0x7fe76000bbe0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 shutdown_connections 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe74c0b56e0 0x7fe74c0d5b90 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe770122b10 0x7fe770122fb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe770115410 0x7fe77011d750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 --2- 10.20.193.90:0/2890144760 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe77010f200 0x7fe77011d210 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 >> 10.20.193.90:0/2890144760 conn(0x7fe7700eca60 msgr2=0x7fe77010ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 shutdown_connections 2026-02-19T21:04:56.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:56.329+0000 7fe777cb06c0 1 -- 10.20.193.90:0/2890144760 wait complete. 2026-02-19T21:04:56.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:55 trial105 ceph-mon[33883]: pgmap v189: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2026-02-19T21:04:57.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:56 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2890144760' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:57.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:56 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2890144760' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:57.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:56 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2890144760' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:04:58.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:57 trial175 ceph-mon[34116]: pgmap v190: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-19T21:04:58.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:57 trial105 ceph-mon[33883]: pgmap v190: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-19T21:04:58.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:57 trial090 ceph-mon[31759]: pgmap v190: 97 pgs: 97 active+clean; 645 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2026-02-19T21:04:59.369 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:04:59.495 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:04:59.613 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/3499033637 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 msgr2=0x7fde08175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/3499033637 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde08175db0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=841231317970811426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddf800aa70 tx=0x7fddf802fde0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/3499033637 shutdown_connections 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/3499033637 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde08175db0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=841231317970811426 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/3499033637 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde0810fbf0 0x7fde08114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/3499033637 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde0810f200 0x7fde0810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/3499033637 >> 10.20.193.90:0/3499033637 conn(0x7fde080eca60 msgr2=0x7fde0810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/3499033637 shutdown_connections 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/3499033637 wait complete. 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 Processor -- start 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- start start 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde0810f200 0x7fde0811d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde0811d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde08122b90 0x7fde08123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde081235a0 con 0x7fde08115410 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde08123710 con 0x7fde08122b90 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde0d2e86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde081238d0 con 0x7fde0810f200 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde0811d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde0811d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50850/0 (socket says 10.20.193.90:50850) 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 -- 10.20.193.90:0/829066341 learned_addr learned my addr 10.20.193.90:0/829066341 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde077fe6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde08122b90 0x7fde08123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde06ffd6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde0810f200 0x7fde0811d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 -- 10.20.193.90:0/829066341 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde0810f200 msgr2=0x7fde0811d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde0810f200 0x7fde0811d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 -- 10.20.193.90:0/829066341 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde08122b90 msgr2=0x7fde08123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde08122b90 0x7fde08123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde067fc6c0 1 -- 10.20.193.90:0/829066341 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf800a660 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.611+0000 7fde077fe6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde08122b90 0x7fde08123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fde067fc6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde0811d7d0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddf0005fd0 tx=0x7fddf000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddf0004280 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fddf00043e0 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde08163d80 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddf000ccd0 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde08164260 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.612+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde081104d0 con 0x7fde08115410 2026-02-19T21:04:59.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.614+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fddf00026b0 con 0x7fde08115410 2026-02-19T21:04:59.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.614+0000 7fdde7fff6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdddc0b5760 0x7fdddc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:04:59.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.614+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fddf00e3c60 con 0x7fde08115410 2026-02-19T21:04:59.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.614+0000 7fde06ffd6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdddc0b5760 0x7fdddc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:04:59.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.615+0000 7fde06ffd6c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdddc0b5760 0x7fdddc0d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddfc005980 tx=0x7fddfc005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:04:59.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.615+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fddf00a64f0 con 0x7fde08115410 2026-02-19T21:04:59.731 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.730+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fde0811e3e0 con 0x7fde08115410 2026-02-19T21:04:59.731 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.730+0000 7fdde7fff6c0 1 -- 10.20.193.90:0/829066341 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fddf000ce60 con 0x7fde08115410 2026-02-19T21:04:59.731 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:04:59.732 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:04:59.732 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdddc0b5760 msgr2=0x7fdddc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:59.732 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdddc0b5760 0x7fdddc0d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddfc005980 tx=0x7fddfc005910 comp rx=0 tx=0).stop 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 msgr2=0x7fde0811d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde0811d7d0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddf0005fd0 tx=0x7fddf000bca0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 shutdown_connections 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdddc0b5760 0x7fdddc0d5c10 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fde08122b90 0x7fde08123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fde08115410 0x7fde0811d7d0 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 --2- 10.20.193.90:0/829066341 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fde0810f200 0x7fde0811d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 >> 10.20.193.90:0/829066341 conn(0x7fde080eca60 msgr2=0x7fde0810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 shutdown_connections 2026-02-19T21:04:59.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:04:59.731+0000 7fde0d2e86c0 1 -- 10.20.193.90:0/829066341 wait complete. 2026-02-19T21:05:00.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:59 trial090 ceph-mon[31759]: pgmap v191: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-19T21:05:00.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:04:59 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/829066341' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:00.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:59 trial175 ceph-mon[34116]: pgmap v191: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-19T21:05:00.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:04:59 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/829066341' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:00.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:59 trial105 ceph-mon[33883]: pgmap v191: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2026-02-19T21:05:00.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:04:59 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/829066341' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:02.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:01 trial175 ceph-mon[34116]: pgmap v192: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:02.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:01 trial105 ceph-mon[33883]: pgmap v192: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:02.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:01 trial090 ceph-mon[31759]: pgmap v192: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:02.771 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:02.898 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:03.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 -- 10.20.193.90:0/694558811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8618115410 msgr2=0x7f8618175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:03.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 --2- 10.20.193.90:0/694558811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8618115410 0x7f8618175db0 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=15807659785777054594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f860c00aa70 tx=0x7f860c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 -- 10.20.193.90:0/694558811 shutdown_connections 2026-02-19T21:05:03.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 --2- 10.20.193.90:0/694558811 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f8618115410 0x7f8618175db0 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=15807659785777054594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.015 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 --2- 10.20.193.90:0/694558811 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f861810fbf0 0x7f8618114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 --2- 10.20.193.90:0/694558811 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f861810f200 0x7f861810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 -- 10.20.193.90:0/694558811 >> 10.20.193.90:0/694558811 conn(0x7f86180eca60 msgr2=0x7f861810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 -- 10.20.193.90:0/694558811 shutdown_connections 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 -- 10.20.193.90:0/694558811 wait complete. 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 Processor -- start 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 -- start start 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 0x7f861811d210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.011+0000 7f861e5316c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8618115410 0x7f861811d750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8618122b10 0x7f8618122fb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8618123520 con 0x7f861810f200 2026-02-19T21:05:03.016 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8618123690 con 0x7f8618122b10 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8618123850 con 0x7f8618115410 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 0x7f861811d210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 0x7f861811d210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50870/0 (socket says 10.20.193.90:50870) 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 -- 10.20.193.90:0/839725339 learned_addr learned my addr 10.20.193.90:0/839725339 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f86177fe6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8618115410 0x7f861811d750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 -- 10.20.193.90:0/839725339 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8618115410 msgr2=0x7f861811d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861caa36c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8618122b10 0x7f8618122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8618115410 0x7f861811d750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 -- 10.20.193.90:0/839725339 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8618122b10 msgr2=0x7f8618122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8618122b10 0x7f8618122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 -- 10.20.193.90:0/839725339 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c00a660 con 0x7f861810f200 2026-02-19T21:05:03.017 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f86177fe6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8618115410 0x7f861811d750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861caa36c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8618122b10 0x7f8618122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f8617fff6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 0x7f861811d210 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f860400b710 tx=0x7f860400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8604004250 con 0x7f861810f200 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8604009070 con 0x7f861810f200 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8618163d00 con 0x7f861810f200 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f860400ccd0 con 0x7f861810f200 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86181641e0 con 0x7f861810f200 2026-02-19T21:05:03.018 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.012+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86181104d0 con 0x7f861810f200 2026-02-19T21:05:03.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.014+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f86040028c0 con 0x7f861810f200 2026-02-19T21:05:03.019 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.014+0000 7f86157fa6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85ec0b5760 0x7f85ec0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:03.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.015+0000 7f86177fe6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85ec0b5760 0x7f85ec0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:03.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.015+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f86040e3ee0 con 0x7f861810f200 2026-02-19T21:05:03.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.015+0000 7f86177fe6c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85ec0b5760 0x7f85ec0d5c10 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8618123ba0 tx=0x7f8608005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:03.020 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.015+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f86040a6730 con 0x7f861810f200 2026-02-19T21:05:03.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.130+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f861810f5d0 con 0x7f861810f200 2026-02-19T21:05:03.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.130+0000 7f86157fa6c0 1 -- 10.20.193.90:0/839725339 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f860400ce60 con 0x7f861810f200 2026-02-19T21:05:03.134 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:03.134 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:03.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85ec0b5760 msgr2=0x7f85ec0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:03.135 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85ec0b5760 0x7f85ec0d5c10 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8618123ba0 tx=0x7f8608005f10 comp rx=0 tx=0).stop 2026-02-19T21:05:03.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 msgr2=0x7f861811d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:03.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 0x7f861811d210 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f860400b710 tx=0x7f860400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 shutdown_connections 2026-02-19T21:05:03.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f85ec0b5760 0x7f85ec0d5c10 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8618122b10 0x7f8618122fb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.136 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8618115410 0x7f861811d750 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 --2- 10.20.193.90:0/839725339 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f861810f200 0x7f861811d210 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:03.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 >> 10.20.193.90:0/839725339 conn(0x7f86180eca60 msgr2=0x7f861810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:03.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 shutdown_connections 2026-02-19T21:05:03.137 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:03.132+0000 7f861e5316c0 1 -- 10.20.193.90:0/839725339 wait complete. 2026-02-19T21:05:04.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:03 trial175 ceph-mon[34116]: pgmap v193: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:04.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:03 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/839725339' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:04.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:03 trial105 ceph-mon[33883]: pgmap v193: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:04.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:03 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/839725339' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:04.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:03 trial090 ceph-mon[31759]: pgmap v193: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:04.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:03 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/839725339' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:06.175 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:06.202 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:05 trial090 ceph-mon[31759]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:06.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:05 trial175 ceph-mon[34116]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:06.302 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:06.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:05 trial105 ceph-mon[33883]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 -- 10.20.193.90:0/1897721030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414113180 msgr2=0x7f4414173b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 --2- 10.20.193.90:0/1897721030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414113180 0x7f4414173b20 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=3842041016024155964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f440800aa70 tx=0x7f440802fde0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 -- 10.20.193.90:0/1897721030 shutdown_connections 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 --2- 10.20.193.90:0/1897721030 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414113180 0x7f4414173b20 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=3842041016024155964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 --2- 10.20.193.90:0/1897721030 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f441410d960 0x7f44141129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 --2- 10.20.193.90:0/1897721030 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f441410cf70 0x7f441410d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 -- 10.20.193.90:0/1897721030 >> 10.20.193.90:0/1897721030 conn(0x7f44140ea870 msgr2=0x7f441410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:06.418 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 -- 10.20.193.90:0/1897721030 shutdown_connections 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.413+0000 7f441c9346c0 1 -- 10.20.193.90:0/1897721030 wait complete. 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 Processor -- start 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 -- start start 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f441410cf70 0x7f44140606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4414113180 0x7f4414060c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 0x7f44141631f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44140626c0 con 0x7f4414061140 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4414163730 con 0x7f4414113180 2026-02-19T21:05:06.419 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44141638f0 con 0x7f441410cf70 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 0x7f44141631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 0x7f44141631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34092/0 (socket says 10.20.193.90:34092) 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 -- 10.20.193.90:0/3336835247 learned_addr learned my addr 10.20.193.90:0/3336835247 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f4419ea86c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4414113180 0x7f4414060c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441a6a96c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f441410cf70 0x7f44140606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 -- 10.20.193.90:0/3336835247 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f441410cf70 msgr2=0x7f44140606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f441410cf70 0x7f44140606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 -- 10.20.193.90:0/3336835247 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4414113180 msgr2=0x7f4414060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4414113180 0x7f4414060c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.420 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 -- 10.20.193.90:0/3336835247 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440800a660 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441aeaa6c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 0x7f44141631f0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44080054b0 tx=0x7f44080054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4408003a30 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4408003b90 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4414163b70 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44080382f0 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.414+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4414163ff0 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.415+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441410e240 con 0x7f4414061140 2026-02-19T21:05:06.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.416+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f4408008260 con 0x7f4414061140 2026-02-19T21:05:06.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.417+0000 7f43ff7fe6c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43f00b5760 0x7f43f00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:06.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.417+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f4408109050 con 0x7f4414061140 2026-02-19T21:05:06.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.417+0000 7f441a6a96c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43f00b5760 0x7f43f00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:06.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.417+0000 7f441a6a96c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43f00b5760 0x7f43f00d5c10 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f440c005980 tx=0x7f440c005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:06.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.417+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f44080cb8e0 con 0x7f4414061140 2026-02-19T21:05:06.533 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.532+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f441410d340 con 0x7f4414061140 2026-02-19T21:05:06.534 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.532+0000 7f43ff7fe6c0 1 -- 10.20.193.90:0/3336835247 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f44080cea90 con 0x7f4414061140 2026-02-19T21:05:06.534 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:06.534 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43f00b5760 msgr2=0x7f43f00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43f00b5760 0x7f43f00d5c10 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f440c005980 tx=0x7f440c005910 comp rx=0 tx=0).stop 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 msgr2=0x7f44141631f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 0x7f44141631f0 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44080054b0 tx=0x7f44080054e0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 shutdown_connections 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f43f00b5760 0x7f43f00d5c10 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4414061140 0x7f44141631f0 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4414113180 0x7f4414060c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 --2- 10.20.193.90:0/3336835247 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f441410cf70 0x7f44140606c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 >> 10.20.193.90:0/3336835247 conn(0x7f44140ea870 msgr2=0x7f441410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 shutdown_connections 2026-02-19T21:05:06.535 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:06.533+0000 7f441c9346c0 1 -- 10.20.193.90:0/3336835247 wait complete. 2026-02-19T21:05:07.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:06 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3336835247' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:07.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:06 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3336835247' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:07.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:06 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3336835247' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:08.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:07 trial175 ceph-mon[34116]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:08.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:07 trial105 ceph-mon[33883]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:08.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:07 trial090 ceph-mon[31759]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:09.575 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:09.701 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/419098193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f706810fbf0 msgr2=0x7f7068114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/419098193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f706810fbf0 0x7f7068114c30 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=13970777227744681865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70580099a0 tx=0x7f705802ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/419098193 shutdown_connections 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/419098193 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7068115410 0x7f7068175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/419098193 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f706810fbf0 0x7f7068114c30 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=13970777227744681865 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/419098193 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f706810f200 0x7f706810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/419098193 >> 10.20.193.90:0/419098193 conn(0x7f70680eca60 msgr2=0x7f706810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/419098193 shutdown_connections 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/419098193 wait complete. 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 Processor -- start 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- start start 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f706810f200 0x7f70680f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7068115410 0x7f7068175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 0x7f70680fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f70680f5930 con 0x7f70680f5240 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f70680faa50 con 0x7f706810f200 2026-02-19T21:05:09.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f706dc4b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f70680fac10 con 0x7f7068115410 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 0x7f70680fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 0x7f70680fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34108/0 (socket says 10.20.193.90:34108) 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 -- 10.20.193.90:0/2494022537 learned_addr learned my addr 10.20.193.90:0/2494022537 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f70677fe6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f706810f200 0x7f70680f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7066ffd6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7068115410 0x7f7068175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 -- 10.20.193.90:0/2494022537 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7068115410 msgr2=0x7f7068175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7068115410 0x7f7068175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 -- 10.20.193.90:0/2494022537 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f706810f200 msgr2=0x7f70680f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f706810f200 0x7f70680f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.809+0000 7f7067fff6c0 1 -- 10.20.193.90:0/2494022537 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7058009590 con 0x7f70680f5240 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f7067fff6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 0x7f70680fa510 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f705c006ea0 tx=0x7f705c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f705c003a30 con 0x7f70680f5240 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f705c0054f0 con 0x7f70680f5240 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70680faef0 con 0x7f70680f5240 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f705c00dcd0 con 0x7f70680f5240 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70680fb680 con 0x7f70680f5240 2026-02-19T21:05:09.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.810+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70680fb3a0 con 0x7f70680f5240 2026-02-19T21:05:09.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.812+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f705c003b90 con 0x7f70680f5240 2026-02-19T21:05:09.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.812+0000 7f7064ff96c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f703c0b56e0 0x7f703c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:09.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.812+0000 7f70677fe6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f703c0b56e0 0x7f703c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:09.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.812+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f705c0e4d20 con 0x7f70680f5240 2026-02-19T21:05:09.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.812+0000 7f70677fe6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f703c0b56e0 0x7f703c0d5b90 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7054005980 tx=0x7f7054005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:09.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.813+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f705c0a7570 con 0x7f70680f5240 2026-02-19T21:05:09.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.928+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f70681104d0 con 0x7f70680f5240 2026-02-19T21:05:09.930 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.928+0000 7f7064ff96c0 1 -- 10.20.193.90:0/2494022537 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f705c00de60 con 0x7f70680f5240 2026-02-19T21:05:09.930 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:09.930 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f703c0b56e0 msgr2=0x7f703c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f703c0b56e0 0x7f703c0d5b90 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7054005980 tx=0x7f7054005910 comp rx=0 tx=0).stop 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 msgr2=0x7f70680fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 0x7f70680fa510 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f705c006ea0 tx=0x7f705c00cca0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 shutdown_connections 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f703c0b56e0 0x7f703c0d5b90 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f70680f5240 0x7f70680fa510 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7068115410 0x7f7068175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 --2- 10.20.193.90:0/2494022537 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f706810f200 0x7f70680f4c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 >> 10.20.193.90:0/2494022537 conn(0x7f70680eca60 msgr2=0x7f706810d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 shutdown_connections 2026-02-19T21:05:09.931 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:09.929+0000 7f706dc4b6c0 1 -- 10.20.193.90:0/2494022537 wait complete. 2026-02-19T21:05:10.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:09 trial175 ceph-mon[34116]: pgmap v196: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-19T21:05:10.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:09 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2494022537' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:09 trial105 ceph-mon[33883]: pgmap v196: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-19T21:05:10.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:09 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2494022537' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:10.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:09 trial090 ceph-mon[31759]: pgmap v196: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s 2026-02-19T21:05:10.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:09 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2494022537' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:12.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:11 trial175 ceph-mon[34116]: pgmap v197: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:12.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:11 trial105 ceph-mon[33883]: pgmap v197: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:12.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:11 trial090 ceph-mon[31759]: pgmap v197: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:12.972 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:13.098 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:13.209 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/4285396154 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c10fbf0 msgr2=0x7f4d0c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:13.209 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/4285396154 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c10fbf0 0x7f4d0c114c30 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=18411321831130564718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cfc0099a0 tx=0x7f4cfc02ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/4285396154 shutdown_connections 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/4285396154 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d0c115410 0x7f4d0c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/4285396154 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c10fbf0 0x7f4d0c114c30 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=18411321831130564718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/4285396154 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d0c10f200 0x7f4d0c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/4285396154 >> 10.20.193.90:0/4285396154 conn(0x7f4d0c0eca60 msgr2=0x7f4d0c10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/4285396154 shutdown_connections 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.207+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/4285396154 wait complete. 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 Processor -- start 2026-02-19T21:05:13.210 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 -- start start 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d0c10f200 0x7f4d0c0f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d0c115410 0x7f4d0c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 0x7f4d0c0fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0f5910 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0faa30 con 0x7f4d0c10f200 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d1225c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0fabf0 con 0x7f4d0c115410 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 0x7f4d0c0fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 0x7f4d0c0fa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:34132/0 (socket says 10.20.193.90:34132) 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 -- 10.20.193.90:0/831696749 learned_addr learned my addr 10.20.193.90:0/831696749 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0affd6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d0c115410 0x7f4d0c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0b7fe6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d0c10f200 0x7f4d0c0f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 -- 10.20.193.90:0/831696749 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d0c115410 msgr2=0x7f4d0c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d0c115410 0x7f4d0c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 -- 10.20.193.90:0/831696749 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d0c10f200 msgr2=0x7f4d0c0f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d0c10f200 0x7f4d0c0f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 -- 10.20.193.90:0/831696749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc009590 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d0bfff6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 0x7f4d0c0fa4f0 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d0000c6c0 tx=0x7f4d0000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.208+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d00003c40 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.209+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c0faed0 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.209+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4d0000a030 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.209+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d0000db70 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.209+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c0fb660 con 0x7f4d0c0f5220 2026-02-19T21:05:13.211 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.209+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c0fb380 con 0x7f4d0c0f5220 2026-02-19T21:05:13.212 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.210+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f4d0000dd20 con 0x7f4d0c0f5220 2026-02-19T21:05:13.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.211+0000 7f4d08ff96c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4ce00b56e0 0x7f4ce00d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:13.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.211+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f4d000e4ac0 con 0x7f4d0c0f5220 2026-02-19T21:05:13.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.211+0000 7f4d0b7fe6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4ce00b56e0 0x7f4ce00d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:13.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.211+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d000a7310 con 0x7f4d0c0f5220 2026-02-19T21:05:13.213 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.211+0000 7f4d0b7fe6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4ce00b56e0 0x7f4ce00d5b90 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf8005980 tx=0x7f4cf80094b0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:13.329 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.327+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d0c1104d0 con 0x7f4d0c0f5220 2026-02-19T21:05:13.329 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.327+0000 7f4d08ff96c0 1 -- 10.20.193.90:0/831696749 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d000aa4c0 con 0x7f4d0c0f5220 2026-02-19T21:05:13.329 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:13.329 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:13.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4ce00b56e0 msgr2=0x7f4ce00d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:13.330 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4ce00b56e0 0x7f4ce00d5b90 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf8005980 tx=0x7f4cf80094b0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 msgr2=0x7f4d0c0fa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 0x7f4d0c0fa4f0 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d0000c6c0 tx=0x7f4d0000cb90 comp rx=0 tx=0).stop 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 shutdown_connections 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4ce00b56e0 0x7f4ce00d5b90 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d0c0f5220 0x7f4d0c0fa4f0 unknown :-1 s=CLOSED pgs=323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d0c115410 0x7f4d0c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 --2- 10.20.193.90:0/831696749 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d0c10f200 0x7f4d0c0f4bf0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 >> 10.20.193.90:0/831696749 conn(0x7f4d0c0eca60 msgr2=0x7f4d0c111b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 shutdown_connections 2026-02-19T21:05:13.331 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:13.329+0000 7f4d1225c6c0 1 -- 10.20.193.90:0/831696749 wait complete. 2026-02-19T21:05:14.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:13 trial175 ceph-mon[34116]: pgmap v198: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:14.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:13 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/831696749' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:14.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:13 trial105 ceph-mon[33883]: pgmap v198: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:14.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:13 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/831696749' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:14.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:13 trial090 ceph-mon[31759]: pgmap v198: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:14.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:13 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/831696749' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:16.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:15 trial175 ceph-mon[34116]: pgmap v199: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-19T21:05:16.370 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:16.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:15 trial105 ceph-mon[33883]: pgmap v199: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-19T21:05:16.396 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:15 trial090 ceph-mon[31759]: pgmap v199: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2026-02-19T21:05:16.495 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:16.627 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/1573669070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa59410f200 msgr2=0x7fa59410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:16.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/1573669070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa59410f200 0x7fa59410f5d0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=398808220310203413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5840099a0 tx=0x7fa58402ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:16.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/1573669070 shutdown_connections 2026-02-19T21:05:16.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/1573669070 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa594115410 0x7fa594175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/1573669070 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa59410fbf0 0x7fa594114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/1573669070 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa59410f200 0x7fa59410f5d0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=398808220310203413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.628 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/1573669070 >> 10.20.193.90:0/1573669070 conn(0x7fa5940eca60 msgr2=0x7fa59410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/1573669070 shutdown_connections 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.621+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/1573669070 wait complete. 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 Processor -- start 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 -- start start 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa59410f200 0x7fa59411d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 0x7fa59411d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa594122c80 0x7fa594123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:16.629 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa594123690 con 0x7fa594115410 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa594123800 con 0x7fa59410f200 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa59aecf6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5941239c0 con 0x7fa594122c80 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 0x7fa59411d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 0x7fa59411d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37224/0 (socket says 10.20.193.90:37224) 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 -- 10.20.193.90:0/3957466865 learned_addr learned my addr 10.20.193.90:0/3957466865 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa5994416c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa594122c80 0x7fa594123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa598c406c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa59410f200 0x7fa59411d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 -- 10.20.193.90:0/3957466865 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa594122c80 msgr2=0x7fa594123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:16.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa594122c80 0x7fa594123120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 -- 10.20.193.90:0/3957466865 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa59410f200 msgr2=0x7fa59411d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa59410f200 0x7fa59411d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 -- 10.20.193.90:0/3957466865 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa584009590 con 0x7fa594115410 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa58bfff6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 0x7fa59411d8c0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa57c005fd0 tx=0x7fa57c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.622+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa57c004280 con 0x7fa594115410 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.623+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa57c0043e0 con 0x7fa594115410 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.623+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa594163e70 con 0x7fa594115410 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.623+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa57c00ccd0 con 0x7fa594115410 2026-02-19T21:05:16.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.623+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa594164300 con 0x7fa594115410 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.623+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5941104d0 con 0x7fa594115410 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.624+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fa57c0026b0 con 0x7fa594115410 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.625+0000 7fa589ffb6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa5700b56e0 0x7fa5700d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.625+0000 7fa598c406c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa5700b56e0 0x7fa5700d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.625+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fa57c0e3e30 con 0x7fa594115410 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.625+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa57c0aa0e0 con 0x7fa594115410 2026-02-19T21:05:16.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.625+0000 7fa598c406c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa5700b56e0 0x7fa5700d5b90 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5840092e0 tx=0x7fa584005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:16.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.739+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa59410f5d0 con 0x7fa594115410 2026-02-19T21:05:16.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.739+0000 7fa589ffb6c0 1 -- 10.20.193.90:0/3957466865 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa57c0a9830 con 0x7fa594115410 2026-02-19T21:05:16.742 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:16.742 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:16.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa5700b56e0 msgr2=0x7fa5700d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:16.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa5700b56e0 0x7fa5700d5b90 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5840092e0 tx=0x7fa584005c00 comp rx=0 tx=0).stop 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 msgr2=0x7fa59411d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 0x7fa59411d8c0 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa57c005fd0 tx=0x7fa57c00bca0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 shutdown_connections 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa5700b56e0 0x7fa5700d5b90 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa594122c80 0x7fa594123120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa594115410 0x7fa59411d8c0 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 --2- 10.20.193.90:0/3957466865 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa59410f200 0x7fa59411d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 >> 10.20.193.90:0/3957466865 conn(0x7fa5940eca60 msgr2=0x7fa59410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 shutdown_connections 2026-02-19T21:05:16.743 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:16.740+0000 7fa59aecf6c0 1 -- 10.20.193.90:0/3957466865 wait complete. 2026-02-19T21:05:17.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:16 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3957466865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:17.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:16 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3957466865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:17.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:16 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3957466865' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:18.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:17 trial175 ceph-mon[34116]: pgmap v200: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:18.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:17 trial105 ceph-mon[33883]: pgmap v200: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:18.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:17 trial090 ceph-mon[31759]: pgmap v200: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2026-02-19T21:05:19.781 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:19.905 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- 10.20.193.90:0/457422784 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 msgr2=0x7fccd4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/457422784 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd4175db0 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=13503011601791667361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccd000aa70 tx=0x7fccd002fde0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- 10.20.193.90:0/457422784 shutdown_connections 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/457422784 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd4175db0 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=13503011601791667361 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/457422784 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd410fbf0 0x7fccd4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/457422784 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 0x7fccd410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- 10.20.193.90:0/457422784 >> 10.20.193.90:0/457422784 conn(0x7fccd40eca60 msgr2=0x7fccd410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- 10.20.193.90:0/457422784 shutdown_connections 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- 10.20.193.90:0/457422784 wait complete. 2026-02-19T21:05:20.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 Processor -- start 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- start start 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 0x7fccd411d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd411d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd4122b00 0x7fccd4122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4123510 con 0x7fccd4115410 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4123680 con 0x7fccd4122b00 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccdc3706c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fccd4123840 con 0x7fccd410f200 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.026+0000 7fccd98e46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd411d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd411d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37240/0 (socket says 10.20.193.90:37240) 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 -- 10.20.193.90:0/608212885 learned_addr learned my addr 10.20.193.90:0/608212885 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccda0e56c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 0x7fccd411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 -- 10.20.193.90:0/608212885 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 msgr2=0x7fccd411d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 0x7fccd411d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccda8e66c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd4122b00 0x7fccd4122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:20.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 -- 10.20.193.90:0/608212885 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd4122b00 msgr2=0x7fccd4122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd4122b00 0x7fccd4122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 -- 10.20.193.90:0/608212885 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd000a660 con 0x7fccd4115410 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccda0e56c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 0x7fccd411d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccda8e66c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd4122b00 0x7fccd4122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccd98e46c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd411d740 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccc8005dc0 tx=0x7fccc800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fccc8004250 con 0x7fccd4115410 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fccc8009070 con 0x7fccd4115410 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd4163cf0 con 0x7fccd4115410 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fccc800cd50 con 0x7fccd4115410 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd41641d0 con 0x7fccd4115410 2026-02-19T21:05:20.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.027+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd41104d0 con 0x7fccd4115410 2026-02-19T21:05:20.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.028+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fccc80028c0 con 0x7fccd4115410 2026-02-19T21:05:20.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.029+0000 7fccbb7fe6c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fccb00b5760 0x7fccb00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:20.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.029+0000 7fccda0e56c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fccb00b5760 0x7fccb00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:20.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.029+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fccc80e3d50 con 0x7fccd4115410 2026-02-19T21:05:20.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.029+0000 7fccda0e56c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fccb00b5760 0x7fccb00d5c10 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccc4004750 tx=0x7fccc4005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:20.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.030+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fccc80a65a0 con 0x7fccd4115410 2026-02-19T21:05:20.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.147+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fccd410f5d0 con 0x7fccd4115410 2026-02-19T21:05:20.149 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:19 trial090 ceph-mon[31759]: pgmap v201: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-19T21:05:20.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.147+0000 7fccbb7fe6c0 1 -- 10.20.193.90:0/608212885 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fccc80a9750 con 0x7fccd4115410 2026-02-19T21:05:20.149 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:20.149 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fccb00b5760 msgr2=0x7fccb00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fccb00b5760 0x7fccb00d5c10 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccc4004750 tx=0x7fccc4005f10 comp rx=0 tx=0).stop 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 msgr2=0x7fccd411d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd411d740 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fccc8005dc0 tx=0x7fccc800bbb0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 shutdown_connections 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fccb00b5760 0x7fccb00d5c10 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fccd4122b00 0x7fccd4122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fccd4115410 0x7fccd411d740 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 --2- 10.20.193.90:0/608212885 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fccd410f200 0x7fccd411d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 >> 10.20.193.90:0/608212885 conn(0x7fccd40eca60 msgr2=0x7fccd410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 shutdown_connections 2026-02-19T21:05:20.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:20.148+0000 7fccdc3706c0 1 -- 10.20.193.90:0/608212885 wait complete. 2026-02-19T21:05:20.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:19 trial175 ceph-mon[34116]: pgmap v201: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-19T21:05:20.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:19 trial105 ceph-mon[33883]: pgmap v201: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2026-02-19T21:05:21.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:20 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/608212885' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:21.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:20 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/608212885' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:21.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:20 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/608212885' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:22.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:21 trial175 ceph-mon[34116]: pgmap v202: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:22.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:21 trial105 ceph-mon[33883]: pgmap v202: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:22.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:21 trial090 ceph-mon[31759]: pgmap v202: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:23.190 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:23.314 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:23.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/1531505418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a3410c820 msgr2=0x7f3a34111860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:23.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/1531505418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a3410c820 0x7f3a34111860 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=9847997804696056158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a240099a0 tx=0x7f3a2402ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:23.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/1531505418 shutdown_connections 2026-02-19T21:05:23.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/1531505418 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3a34112040 0x7f3a341729e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/1531505418 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a3410c820 0x7f3a34111860 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=9847997804696056158 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/1531505418 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a3410be30 0x7f3a3410c200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/1531505418 >> 10.20.193.90:0/1531505418 conn(0x7f3a340e96f0 msgr2=0x7f3a34109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/1531505418 shutdown_connections 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.433+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/1531505418 wait complete. 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 Processor -- start 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 -- start start 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3a3410be30 0x7f3a340f4c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 0x7f3a341728e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a340f52a0 0x7f3a340fa570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340f5990 con 0x7f3a34112040 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340faab0 con 0x7f3a340f52a0 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3a340fac70 con 0x7f3a3410be30 2026-02-19T21:05:23.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 0x7f3a341728e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 0x7f3a341728e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37256/0 (socket says 10.20.193.90:37256) 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 -- 10.20.193.90:0/3358868407 learned_addr learned my addr 10.20.193.90:0/3358868407 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a337fe6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3a3410be30 0x7f3a340f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a33fff6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a340f52a0 0x7f3a340fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 -- 10.20.193.90:0/3358868407 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3a3410be30 msgr2=0x7f3a340f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3a3410be30 0x7f3a340f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 -- 10.20.193.90:0/3358868407 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a340f52a0 msgr2=0x7f3a340fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a340f52a0 0x7f3a340fa570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 -- 10.20.193.90:0/3358868407 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a24009590 con 0x7f3a34112040 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a33fff6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a340f52a0 0x7f3a340fa570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a32ffd6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 0x7f3a341728e0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a240023c0 tx=0x7f3a2402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:23.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a24002ae0 con 0x7f3a34112040 2026-02-19T21:05:23.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3a24002c40 con 0x7f3a34112040 2026-02-19T21:05:23.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a340faef0 con 0x7f3a34112040 2026-02-19T21:05:23.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.434+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a240372f0 con 0x7f3a34112040 2026-02-19T21:05:23.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.435+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a340fb370 con 0x7f3a34112040 2026-02-19T21:05:23.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.435+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3410d100 con 0x7f3a34112040 2026-02-19T21:05:23.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.436+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f3a24007810 con 0x7f3a34112040 2026-02-19T21:05:23.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.437+0000 7f3a30ff96c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3a080b56e0 0x7f3a080d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:23.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.437+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f3a24107e80 con 0x7f3a34112040 2026-02-19T21:05:23.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.437+0000 7f3a337fe6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3a080b56e0 0x7f3a080d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:23.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.437+0000 7f3a337fe6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3a080b56e0 0x7f3a080d5b90 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20005980 tx=0x7f3a20005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:23.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.437+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3a240ca6d0 con 0x7f3a34112040 2026-02-19T21:05:23.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.551+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3a3410c200 con 0x7f3a34112040 2026-02-19T21:05:23.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.551+0000 7f3a30ff96c0 1 -- 10.20.193.90:0/3358868407 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3a24007e60 con 0x7f3a34112040 2026-02-19T21:05:23.554 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:23.555 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3a080b56e0 msgr2=0x7f3a080d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3a080b56e0 0x7f3a080d5b90 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a20005980 tx=0x7f3a20005910 comp rx=0 tx=0).stop 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 msgr2=0x7f3a341728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 0x7f3a341728e0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a240023c0 tx=0x7f3a2402fbf0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 shutdown_connections 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3a080b56e0 0x7f3a080d5b90 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3a340f52a0 0x7f3a340fa570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3a34112040 0x7f3a341728e0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.556 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 --2- 10.20.193.90:0/3358868407 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3a3410be30 0x7f3a340f4c70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:23.557 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 >> 10.20.193.90:0/3358868407 conn(0x7f3a340e96f0 msgr2=0x7f3a3405f450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:23.557 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 shutdown_connections 2026-02-19T21:05:23.557 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:23.553+0000 7f3a39d0d6c0 1 -- 10.20.193.90:0/3358868407 wait complete. 2026-02-19T21:05:24.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:23 trial175 ceph-mon[34116]: pgmap v203: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:24.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:23 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3358868407' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:24.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:23 trial105 ceph-mon[33883]: pgmap v203: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:24.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:23 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3358868407' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:24.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:23 trial090 ceph-mon[31759]: pgmap v203: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:24.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:23 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3358868407' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:26.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:25 trial175 ceph-mon[34116]: pgmap v204: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:05:26.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:25 trial105 ceph-mon[33883]: pgmap v204: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:05:26.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:25 trial090 ceph-mon[31759]: pgmap v204: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:05:26.593 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:26.718 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 -- 10.20.193.90:0/4114036687 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c10fbf0 msgr2=0x7fec3c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 --2- 10.20.193.90:0/4114036687 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c10fbf0 0x7fec3c114c30 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=5969192145706907329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec2c0099a0 tx=0x7fec2c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 -- 10.20.193.90:0/4114036687 shutdown_connections 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 --2- 10.20.193.90:0/4114036687 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec3c115410 0x7fec3c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 --2- 10.20.193.90:0/4114036687 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c10fbf0 0x7fec3c114c30 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=5969192145706907329 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 --2- 10.20.193.90:0/4114036687 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec3c10f200 0x7fec3c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 -- 10.20.193.90:0/4114036687 >> 10.20.193.90:0/4114036687 conn(0x7fec3c0ecac0 msgr2=0x7fec3c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 -- 10.20.193.90:0/4114036687 shutdown_connections 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 -- 10.20.193.90:0/4114036687 wait complete. 2026-02-19T21:05:26.833 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 Processor -- start 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.831+0000 7fec41b576c0 1 -- start start 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec3c10f200 0x7fec3c0f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 0x7fec3c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec3c0f5220 0x7fec3c0fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c0f5880 con 0x7fec3c115410 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c0faa30 con 0x7fec3c10f200 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec3c0fabf0 con 0x7fec3c0f5220 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 0x7fec3c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:26.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 0x7fec3c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58684/0 (socket says 10.20.193.90:58684) 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 -- 10.20.193.90:0/2964388106 learned_addr learned my addr 10.20.193.90:0/2964388106 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3b7fe6c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec3c10f200 0x7fec3c0f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 -- 10.20.193.90:0/2964388106 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec3c0f5220 msgr2=0x7fec3c0fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec3c0f5220 0x7fec3c0fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 -- 10.20.193.90:0/2964388106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec3c10f200 msgr2=0x7fec3c0f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec3c10f200 0x7fec3c0f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 -- 10.20.193.90:0/2964388106 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c009590 con 0x7fec3c115410 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec3affd6c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 0x7fec3c175cb0 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec2c0023c0 tx=0x7fec2c02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec2c002ae0 con 0x7fec3c115410 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fec2c002c40 con 0x7fec3c115410 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3c0fae10 con 0x7fec3c115410 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec2c0372f0 con 0x7fec3c115410 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec3c0fb2e0 con 0x7fec3c115410 2026-02-19T21:05:26.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.832+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3c1104d0 con 0x7fec3c115410 2026-02-19T21:05:26.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.834+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fec2c007810 con 0x7fec3c115410 2026-02-19T21:05:26.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.835+0000 7fec38ff96c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec100b5760 0x7fec100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:26.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.835+0000 7fec3b7fe6c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec100b5760 0x7fec100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:26.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.835+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fec2c107f10 con 0x7fec3c115410 2026-02-19T21:05:26.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.835+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fec2c0ce1c0 con 0x7fec3c115410 2026-02-19T21:05:26.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.835+0000 7fec3b7fe6c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec100b5760 0x7fec100d5c10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec28005fd0 tx=0x7fec28005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:26.952 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.950+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fec3c10f5d0 con 0x7fec3c115410 2026-02-19T21:05:26.953 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.951+0000 7fec38ff96c0 1 -- 10.20.193.90:0/2964388106 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fec2c0d0230 con 0x7fec3c115410 2026-02-19T21:05:26.953 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:26.953 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:26.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec100b5760 msgr2=0x7fec100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:26.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec100b5760 0x7fec100d5c10 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec28005fd0 tx=0x7fec28005910 comp rx=0 tx=0).stop 2026-02-19T21:05:26.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 msgr2=0x7fec3c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:26.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 0x7fec3c175cb0 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec2c0023c0 tx=0x7fec2c02fbf0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 shutdown_connections 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec100b5760 0x7fec100d5c10 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec3c0f5220 0x7fec3c0fa4f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec3c115410 0x7fec3c175cb0 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 --2- 10.20.193.90:0/2964388106 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec3c10f200 0x7fec3c0f4bf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 >> 10.20.193.90:0/2964388106 conn(0x7fec3c0ecac0 msgr2=0x7fec3c113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 shutdown_connections 2026-02-19T21:05:26.955 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:26.952+0000 7fec41b576c0 1 -- 10.20.193.90:0/2964388106 wait complete. 2026-02-19T21:05:27.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2964388106' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:27.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:26 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2964388106' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:27.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:26 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2964388106' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:28.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:27 trial090 ceph-mon[31759]: pgmap v205: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:28.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:27 trial175 ceph-mon[34116]: pgmap v205: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:28.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:27 trial105 ceph-mon[33883]: pgmap v205: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:05:29.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:28 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:05:29.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:28 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:05:29.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:28 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:05:29.992 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:30.116 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: pgmap v206: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:05:30.181 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:29 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:05:30.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/2070471806 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec410f200 msgr2=0x7f6ec410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:30.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/2070471806 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec410f200 0x7f6ec410f5d0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=17381359561861751041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6eb00099a0 tx=0x7f6eb002ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:30.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/2070471806 shutdown_connections 2026-02-19T21:05:30.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/2070471806 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4115410 0x7f6ec4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.238 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/2070471806 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410fbf0 0x7f6ec4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/2070471806 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec410f200 0x7f6ec410f5d0 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=17381359561861751041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/2070471806 >> 10.20.193.90:0/2070471806 conn(0x7f6ec40ecac0 msgr2=0x7f6ec410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/2070471806 shutdown_connections 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.234+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/2070471806 wait complete. 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 Processor -- start 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 -- start start 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410f200 0x7f6ec411d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 0x7f6ec411d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:30.239 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4122c30 0x7f6ec41230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:30.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec4123640 con 0x7f6ec4115410 2026-02-19T21:05:30.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec41237b0 con 0x7f6ec410f200 2026-02-19T21:05:30.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec4123970 con 0x7f6ec4122c30 2026-02-19T21:05:30.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 0x7f6ec411d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:30.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 0x7f6ec411d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58692/0 (socket says 10.20.193.90:58692) 2026-02-19T21:05:30.240 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 -- 10.20.193.90:0/3295808444 learned_addr learned my addr 10.20.193.90:0/3295808444 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec3fff6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4122c30 0x7f6ec41230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec37fe6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410f200 0x7f6ec411d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 -- 10.20.193.90:0/3295808444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4122c30 msgr2=0x7f6ec41230d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4122c30 0x7f6ec41230d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 -- 10.20.193.90:0/3295808444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410f200 msgr2=0x7f6ec411d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410f200 0x7f6ec411d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 -- 10.20.193.90:0/3295808444 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0009590 con 0x7f6ec4115410 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec37fe6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410f200 0x7f6ec411d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec3fff6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4122c30 0x7f6ec41230d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec2ffd6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 0x7f6ec411d870 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6eb400b6c0 tx=0x7f6eb400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6eb40044a0 con 0x7f6ec4115410 2026-02-19T21:05:30.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6eb4009030 con 0x7f6ec4115410 2026-02-19T21:05:30.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec4163e20 con 0x7f6ec4115410 2026-02-19T21:05:30.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6eb400cc10 con 0x7f6ec4115410 2026-02-19T21:05:30.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.235+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec41642b0 con 0x7f6ec4115410 2026-02-19T21:05:30.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.236+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec41104d0 con 0x7f6ec4115410 2026-02-19T21:05:30.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.237+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f6eb40026b0 con 0x7f6ec4115410 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: pgmap v206: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:05:30.243 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:05:30.244 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.244 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:05:30.244 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:05:30.244 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:29 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:05:30.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.237+0000 7f6ec0ff96c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6e980b56e0 0x7f6e980d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:30.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.238+0000 7f6ec37fe6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6e980b56e0 0x7f6e980d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:30.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.238+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f6eb40e3c00 con 0x7f6ec4115410 2026-02-19T21:05:30.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.238+0000 7f6ec37fe6c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6e980b56e0 0x7f6e980d5b90 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6eb00098c0 tx=0x7f6eb002f580 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:30.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.238+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6eb40a6450 con 0x7f6ec4115410 2026-02-19T21:05:30.353 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.351+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ec410f5d0 con 0x7f6ec4115410 2026-02-19T21:05:30.354 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.352+0000 7f6ec0ff96c0 1 -- 10.20.193.90:0/3295808444 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6eb40a9600 con 0x7f6ec4115410 2026-02-19T21:05:30.354 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:30.354 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:30.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.352+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6e980b56e0 msgr2=0x7f6e980d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:30.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.352+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6e980b56e0 0x7f6e980d5b90 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6eb00098c0 tx=0x7f6eb002f580 comp rx=0 tx=0).stop 2026-02-19T21:05:30.355 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.352+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 msgr2=0x7f6ec411d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.352+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 0x7f6ec411d870 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6eb400b6c0 tx=0x7f6eb400bb90 comp rx=0 tx=0).stop 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 shutdown_connections 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6e980b56e0 0x7f6e980d5b90 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6ec4122c30 0x7f6ec41230d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6ec4115410 0x7f6ec411d870 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 --2- 10.20.193.90:0/3295808444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6ec410f200 0x7f6ec411d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 >> 10.20.193.90:0/3295808444 conn(0x7f6ec40ecac0 msgr2=0x7f6ec410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 shutdown_connections 2026-02-19T21:05:30.356 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:30.353+0000 7f6ec9e586c0 1 -- 10.20.193.90:0/3295808444 wait complete. 2026-02-19T21:05:30.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: pgmap v206: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 6 op/s 2026-02-19T21:05:30.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:05:30.396 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:29 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:05:31.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:30 trial175 ceph-mon[34116]: pgmap v207: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:05:31.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:30 trial175 ceph-mon[34116]: pgmap v208: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:05:31.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:30 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3295808444' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:31.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:30 trial105 ceph-mon[33883]: pgmap v207: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:05:31.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:30 trial105 ceph-mon[33883]: pgmap v208: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:05:31.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:30 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3295808444' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:31.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:30 trial090 ceph-mon[31759]: pgmap v207: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:05:31.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:30 trial090 ceph-mon[31759]: pgmap v208: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:05:31.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:30 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3295808444' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:33.393 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:33.519 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:33.539 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:33 trial090 ceph-mon[31759]: pgmap v209: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:05:33.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 -- 10.20.193.90:0/3131160340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac10fbf0 msgr2=0x7f9aac114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:33.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/3131160340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac10fbf0 0x7f9aac114c30 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=2615091639770224717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa00099a0 tx=0x7f9aa002ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:33.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 -- 10.20.193.90:0/3131160340 shutdown_connections 2026-02-19T21:05:33.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/3131160340 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9aac115410 0x7f9aac175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/3131160340 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac10fbf0 0x7f9aac114c30 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=2615091639770224717 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/3131160340 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9aac10f200 0x7f9aac10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 -- 10.20.193.90:0/3131160340 >> 10.20.193.90:0/3131160340 conn(0x7f9aac0ecac0 msgr2=0x7f9aac10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:33.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 -- 10.20.193.90:0/3131160340 shutdown_connections 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.625+0000 7f9ab35456c0 1 -- 10.20.193.90:0/3131160340 wait complete. 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 Processor -- start 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 -- start start 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9aac10f200 0x7f9aac0f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9aac115410 0x7f9aac175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 0x7f9aac0fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:33.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0f5950 con 0x7f9aac0f5260 2026-02-19T21:05:33.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0faa70 con 0x7f9aac10f200 2026-02-19T21:05:33.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9aac0fac30 con 0x7f9aac115410 2026-02-19T21:05:33.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 0x7f9aac0fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:33.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 0x7f9aac0fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:58708/0 (socket says 10.20.193.90:58708) 2026-02-19T21:05:33.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 -- 10.20.193.90:0/560004758 learned_addr learned my addr 10.20.193.90:0/560004758 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:33.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab12b66c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9aac10f200 0x7f9aac0f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:33.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab0ab56c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9aac115410 0x7f9aac175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:33.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 -- 10.20.193.90:0/560004758 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9aac115410 msgr2=0x7f9aac175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:33.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9aac115410 0x7f9aac175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 -- 10.20.193.90:0/560004758 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9aac10f200 msgr2=0x7f9aac0f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:33.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9aac10f200 0x7f9aac0f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 -- 10.20.193.90:0/560004758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa0009590 con 0x7f9aac0f5260 2026-02-19T21:05:33.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab1ab76c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 0x7f9aac0fa530 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa8006ea0 tx=0x7f9aa800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:33.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa8003a30 con 0x7f9aac0f5260 2026-02-19T21:05:33.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9aa80054f0 con 0x7f9aac0f5260 2026-02-19T21:05:33.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aac0faf10 con 0x7f9aac0f5260 2026-02-19T21:05:33.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9aa800dcd0 con 0x7f9aac0f5260 2026-02-19T21:05:33.637 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.626+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aac0fb3a0 con 0x7f9aac0f5260 2026-02-19T21:05:33.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.627+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aac1104d0 con 0x7f9aac0f5260 2026-02-19T21:05:33.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.628+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f9aa8003b90 con 0x7f9aac0f5260 2026-02-19T21:05:33.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.629+0000 7f9a9a7fc6c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a880b56e0 0x7f9a880d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:33.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.629+0000 7f9ab12b66c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a880b56e0 0x7f9a880d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:33.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.629+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f9aa80e4bb0 con 0x7f9aac0f5260 2026-02-19T21:05:33.638 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.629+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9aa80aae60 con 0x7f9aac0f5260 2026-02-19T21:05:33.639 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.629+0000 7f9ab12b66c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a880b56e0 0x7f9a880d5b90 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a9c004750 tx=0x7f9a9c009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:33.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:33 trial105 ceph-mon[33883]: pgmap v209: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:05:33.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.742+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9aac0fb3a0 con 0x7f9aac0f5260 2026-02-19T21:05:33.744 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.742+0000 7f9a9a7fc6c0 1 -- 10.20.193.90:0/560004758 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9aa800de60 con 0x7f9aac0f5260 2026-02-19T21:05:33.745 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:33.745 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a880b56e0 msgr2=0x7f9a880d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a880b56e0 0x7f9a880d5b90 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a9c004750 tx=0x7f9a9c009390 comp rx=0 tx=0).stop 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 msgr2=0x7f9aac0fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 0x7f9aac0fa530 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9aa8006ea0 tx=0x7f9aa800cca0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 shutdown_connections 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9a880b56e0 0x7f9a880d5b90 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9aac0f5260 0x7f9aac0fa530 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9aac115410 0x7f9aac175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 --2- 10.20.193.90:0/560004758 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9aac10f200 0x7f9aac0f4c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:33.746 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 >> 10.20.193.90:0/560004758 conn(0x7f9aac0ecac0 msgr2=0x7f9aac10d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:33.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 shutdown_connections 2026-02-19T21:05:33.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:33.743+0000 7f9ab35456c0 1 -- 10.20.193.90:0/560004758 wait complete. 2026-02-19T21:05:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:33 trial175 ceph-mon[34116]: pgmap v209: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:05:34.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:34 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/560004758' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:34.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:34 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/560004758' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:34 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/560004758' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:35.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:35 trial105 ceph-mon[33883]: pgmap v210: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-19T21:05:35.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:35 trial090 ceph-mon[31759]: pgmap v210: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-19T21:05:35.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:35 trial175 ceph-mon[34116]: pgmap v210: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 6 op/s 2026-02-19T21:05:36.783 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:36.909 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:37.030 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 -- 10.20.193.90:0/3936324046 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 msgr2=0x7f3e3810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3936324046 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3810f5d0 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=16182267185673270731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e280099a0 tx=0x7f3e2802ed00 comp rx=0 tx=0).stop 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 -- 10.20.193.90:0/3936324046 shutdown_connections 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3936324046 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3e38115410 0x7f3e38175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3936324046 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e3810fbf0 0x7f3e38114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3936324046 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3810f5d0 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=16182267185673270731 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 -- 10.20.193.90:0/3936324046 >> 10.20.193.90:0/3936324046 conn(0x7f3e380ecac0 msgr2=0x7f3e3810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 -- 10.20.193.90:0/3936324046 shutdown_connections 2026-02-19T21:05:37.031 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.027+0000 7f3e402456c0 1 -- 10.20.193.90:0/3936324046 wait complete. 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 Processor -- start 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 -- start start 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3811d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e38115410 0x7f3e3811d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3e38122b60 0x7f3e38123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38123540 con 0x7f3e3810f200 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e381236b0 con 0x7f3e38115410 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e402456c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38123870 con 0x7f3e38122b60 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3811d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3811d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:51664/0 (socket says 10.20.193.90:51664) 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 -- 10.20.193.90:0/3620814002 learned_addr learned my addr 10.20.193.90:0/3620814002 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:37.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3e7b76c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3e38122b60 0x7f3e38123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3d7b56c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e38115410 0x7f3e3811d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 -- 10.20.193.90:0/3620814002 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3e38122b60 msgr2=0x7f3e38123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3e38122b60 0x7f3e38123000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 -- 10.20.193.90:0/3620814002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e38115410 msgr2=0x7f3e3811d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e38115410 0x7f3e3811d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 -- 10.20.193.90:0/3620814002 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e28009590 con 0x7f3e3810f200 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3d7b56c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e38115410 0x7f3e3811d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e3dfb66c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3811d260 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e28031f90 tx=0x7f3e2802fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.028+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e28002ba0 con 0x7f3e3810f200 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.029+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3e28007680 con 0x7f3e3810f200 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.029+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e38163cf0 con 0x7f3e3810f200 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.029+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3e280314e0 con 0x7f3e3810f200 2026-02-19T21:05:37.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.029+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e381641c0 con 0x7f3e3810f200 2026-02-19T21:05:37.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.029+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e381104d0 con 0x7f3e3810f200 2026-02-19T21:05:37.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.030+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7f3e28002d00 con 0x7f3e3810f200 2026-02-19T21:05:37.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.031+0000 7f3e26ffd6c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3e140b5760 0x7f3e140d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:37.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.031+0000 7f3e3d7b56c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3e140b5760 0x7f3e140d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:37.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.031+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f3e28108050 con 0x7f3e3810f200 2026-02-19T21:05:37.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.032+0000 7f3e3d7b56c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3e140b5760 0x7f3e140d5c10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e38123bf0 tx=0x7f3e2c005e50 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:37.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.032+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3e280ce340 con 0x7f3e3810f200 2026-02-19T21:05:37.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.144+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3e3811e3b0 con 0x7f3e3810f200 2026-02-19T21:05:37.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.145+0000 7f3e26ffd6c0 1 -- 10.20.193.90:0/3620814002 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3e280949e0 con 0x7f3e3810f200 2026-02-19T21:05:37.146 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:37.146 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:37.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3e140b5760 msgr2=0x7f3e140d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:37.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3e140b5760 0x7f3e140d5c10 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e38123bf0 tx=0x7f3e2c005e50 comp rx=0 tx=0).stop 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 msgr2=0x7f3e3811d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3811d260 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e28031f90 tx=0x7f3e2802fca0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 shutdown_connections 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3e140b5760 0x7f3e140d5c10 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3e38122b60 0x7f3e38123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3e38115410 0x7f3e3811d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 --2- 10.20.193.90:0/3620814002 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3e3810f200 0x7f3e3811d260 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 >> 10.20.193.90:0/3620814002 conn(0x7f3e380ecac0 msgr2=0x7f3e3810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 shutdown_connections 2026-02-19T21:05:37.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:37.146+0000 7f3e402456c0 1 -- 10.20.193.90:0/3620814002 wait complete. 2026-02-19T21:05:37.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:37 trial090 ceph-mon[31759]: pgmap v211: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 5 op/s 2026-02-19T21:05:37.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:37 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3620814002' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:37.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:37 trial105 ceph-mon[33883]: pgmap v211: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 5 op/s 2026-02-19T21:05:37.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:37 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3620814002' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:37 trial175 ceph-mon[34116]: pgmap v211: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s rd, 5 op/s 2026-02-19T21:05:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:37 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3620814002' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:39.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:39 trial105 ceph-mon[33883]: pgmap v212: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s rd, 4 op/s 2026-02-19T21:05:39.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:39 trial090 ceph-mon[31759]: pgmap v212: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s rd, 4 op/s 2026-02-19T21:05:39.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:39 trial175 ceph-mon[34116]: pgmap v212: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.5 KiB/s rd, 4 op/s 2026-02-19T21:05:40.187 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:40.312 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:40.427 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 -- 10.20.193.90:0/1908874941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda4115950 msgr2=0x7fcda4115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:40.427 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/1908874941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda4115950 0x7fcda4115d20 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=2341145476028950704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd980099a0 tx=0x7fcd9802ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:40.427 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 -- 10.20.193.90:0/1908874941 shutdown_connections 2026-02-19T21:05:40.427 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/1908874941 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda411bb60 0x7fcda417c500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.427 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/1908874941 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4116340 0x7fcda411b380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.427 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/1908874941 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda4115950 0x7fcda4115d20 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=2341145476028950704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.423+0000 7fcda933d6c0 1 -- 10.20.193.90:0/1908874941 >> 10.20.193.90:0/1908874941 conn(0x7fcda405e020 msgr2=0x7fcda405e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- 10.20.193.90:0/1908874941 shutdown_connections 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- 10.20.193.90:0/1908874941 wait complete. 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 Processor -- start 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- start start 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda4115950 0x7fcda4057bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 0x7fcda4058130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4058670 0x7fcda416bd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcda416c290 con 0x7fcda411bb60 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcda416c400 con 0x7fcda4058670 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcda416c5c0 con 0x7fcda4115950 2026-02-19T21:05:40.428 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 0x7fcda4058130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 0x7fcda4058130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:51682/0 (socket says 10.20.193.90:51682) 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 -- 10.20.193.90:0/2723603741 learned_addr learned my addr 10.20.193.90:0/2723603741 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda2ffd6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda4115950 0x7fcda4057bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 -- 10.20.193.90:0/2723603741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda4115950 msgr2=0x7fcda4057bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda4115950 0x7fcda4057bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 -- 10.20.193.90:0/2723603741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4058670 msgr2=0x7fcda416bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda37fe6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4058670 0x7fcda416bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4058670 0x7fcda416bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 -- 10.20.193.90:0/2723603741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd98009590 con 0x7fcda411bb60 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda2ffd6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda4115950 0x7fcda4057bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:40.429 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda37fe6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4058670 0x7fcda416bd50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda27fc6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 0x7fcda4058130 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd8c00b6c0 tx=0x7fcd8c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd8c0044a0 con 0x7fcda411bb60 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcd8c009030 con 0x7fcda411bb60 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda416c8a0 con 0x7fcda411bb60 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd8c00cc10 con 0x7fcda411bb60 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.424+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda416cdd0 con 0x7fcda411bb60 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.425+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda4116c20 con 0x7fcda411bb60 2026-02-19T21:05:40.430 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.426+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 15) ==== 157134+0+0 (secure 0 0 0) 0x7fcd8c0026b0 con 0x7fcda411bb60 2026-02-19T21:05:40.431 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.427+0000 7fcd83fff6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcd780b5760 0x7fcd780d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:40.431 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.427+0000 7fcda2ffd6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcd780b5760 0x7fcd780d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:40.431 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.427+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fcd8c0e3b10 con 0x7fcda411bb60 2026-02-19T21:05:40.431 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.427+0000 7fcda2ffd6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcd780b5760 0x7fcd780d5c10 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd980098c0 tx=0x7fcd9802f580 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:40.432 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.427+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcd8c0a6360 con 0x7fcda411bb60 2026-02-19T21:05:40.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.540+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcda4115d20 con 0x7fcda411bb60 2026-02-19T21:05:40.542 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.541+0000 7fcd83fff6c0 1 -- 10.20.193.90:0/2723603741 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcd8c0a9510 con 0x7fcda411bb60 2026-02-19T21:05:40.542 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:40.542 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:40.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.541+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcd780b5760 msgr2=0x7fcd780d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:40.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.541+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcd780b5760 0x7fcd780d5c10 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd980098c0 tx=0x7fcd9802f580 comp rx=0 tx=0).stop 2026-02-19T21:05:40.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.541+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 msgr2=0x7fcda4058130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.541+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 0x7fcda4058130 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd8c00b6c0 tx=0x7fcd8c00bb90 comp rx=0 tx=0).stop 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 shutdown_connections 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcd780b5760 0x7fcd780d5c10 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcda4058670 0x7fcda416bd50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcda411bb60 0x7fcda4058130 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 --2- 10.20.193.90:0/2723603741 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcda4115950 0x7fcda4057bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 >> 10.20.193.90:0/2723603741 conn(0x7fcda405e020 msgr2=0x7fcda4117110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 shutdown_connections 2026-02-19T21:05:40.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:40.542+0000 7fcda933d6c0 1 -- 10.20.193.90:0/2723603741 wait complete. 2026-02-19T21:05:41.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:41 trial105 ceph-mon[33883]: pgmap v213: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:05:41.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:41 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2723603741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:41.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:41 trial090 ceph-mon[31759]: pgmap v213: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:05:41.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:41 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2723603741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:41.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:41 trial175 ceph-mon[34116]: pgmap v213: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:05:41.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:41 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2723603741' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:43.584 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:43.612 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:43 trial090 ceph-mon[31759]: pgmap v214: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-19T21:05:43.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:43 trial105 ceph-mon[33883]: pgmap v214: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-19T21:05:43.710 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:43.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:43 trial175 ceph-mon[34116]: pgmap v214: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2026-02-19T21:05:43.834 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3734640964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 msgr2=0x7fe3d810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3734640964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d810f5d0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=6082062016427913849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3c80099a0 tx=0x7fe3c802ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3734640964 shutdown_connections 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3734640964 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe3d8115410 0x7fe3d8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3734640964 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe3d810fbf0 0x7fe3d8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3734640964 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d810f5d0 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=6082062016427913849 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3734640964 >> 10.20.193.90:0/3734640964 conn(0x7fe3d80ecac0 msgr2=0x7fe3d810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:43.835 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3734640964 shutdown_connections 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3734640964 wait complete. 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 Processor -- start 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- start start 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d811d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe3d8115410 0x7fe3d811d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe3d8122bf0 0x7fe3d8123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81235d0 con 0x7fe3d810f200 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8123740 con 0x7fe3d8122bf0 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3df90b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d8123900 con 0x7fe3d8115410 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.830+0000 7fe3dd67c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d811d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:51706/0 (socket says 10.20.193.90:51706) 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 -- 10.20.193.90:0/3477148669 learned_addr learned my addr 10.20.193.90:0/3477148669 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:43.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dce7b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe3d8115410 0x7fe3d811d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dde7d6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe3d8122bf0 0x7fe3d8123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 -- 10.20.193.90:0/3477148669 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe3d8115410 msgr2=0x7fe3d811d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe3d8115410 0x7fe3d811d830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 -- 10.20.193.90:0/3477148669 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe3d8122bf0 msgr2=0x7fe3d8123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe3d8122bf0 0x7fe3d8123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 -- 10.20.193.90:0/3477148669 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c8009590 con 0x7fe3d810f200 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3dd67c6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d811d2f0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3c80023c0 tx=0x7fe3c802fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3c8002ba0 con 0x7fe3d810f200 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d8163d80 con 0x7fe3d810f200 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe3c8007680 con 0x7fe3d810f200 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3c8037520 con 0x7fe3d810f200 2026-02-19T21:05:43.837 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d8164250 con 0x7fe3d810f200 2026-02-19T21:05:43.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.831+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d81104d0 con 0x7fe3d810f200 2026-02-19T21:05:43.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.833+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fe3c8002d00 con 0x7fe3d810f200 2026-02-19T21:05:43.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.833+0000 7fe3c67fc6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe3b40b5650 0x7fe3b40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:43.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.834+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fe3c8107f00 con 0x7fe3d810f200 2026-02-19T21:05:43.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.834+0000 7fe3dce7b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe3b40b5650 0x7fe3b40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:43.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.834+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe3c80cd880 con 0x7fe3d810f200 2026-02-19T21:05:43.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.834+0000 7fe3dce7b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe3b40b5650 0x7fe3b40d5b00 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d8123c80 tx=0x7fe3cc005e60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:43.951 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.949+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe3d811e440 con 0x7fe3d810f200 2026-02-19T21:05:43.952 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.950+0000 7fe3c67fc6c0 1 -- 10.20.193.90:0/3477148669 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe3c80cda60 con 0x7fe3d810f200 2026-02-19T21:05:43.952 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:43.952 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:43.953 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.950+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe3b40b5650 msgr2=0x7fe3b40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.950+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe3b40b5650 0x7fe3b40d5b00 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3d8123c80 tx=0x7fe3cc005e60 comp rx=0 tx=0).stop 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.950+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 msgr2=0x7fe3d811d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.950+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d811d2f0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3c80023c0 tx=0x7fe3c802fcc0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 shutdown_connections 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe3b40b5650 0x7fe3b40d5b00 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe3d8122bf0 0x7fe3d8123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe3d8115410 0x7fe3d811d830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 --2- 10.20.193.90:0/3477148669 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe3d810f200 0x7fe3d811d2f0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 >> 10.20.193.90:0/3477148669 conn(0x7fe3d80ecac0 msgr2=0x7fe3d810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 shutdown_connections 2026-02-19T21:05:43.954 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:43.951+0000 7fe3df90b6c0 1 -- 10.20.193.90:0/3477148669 wait complete. 2026-02-19T21:05:44.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:44 trial105 ceph-mon[33883]: mgrmap e16: x(active, since 3m), standbys: z, y 2026-02-19T21:05:44.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:44 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3477148669' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:44.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:44 trial090 ceph-mon[31759]: mgrmap e16: x(active, since 3m), standbys: z, y 2026-02-19T21:05:44.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:44 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3477148669' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:44.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:44 trial175 ceph-mon[34116]: mgrmap e16: x(active, since 3m), standbys: z, y 2026-02-19T21:05:44.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:44 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3477148669' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:45.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:45 trial105 ceph-mon[33883]: pgmap v215: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:45 trial090 ceph-mon[31759]: pgmap v215: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:45.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:45 trial175 ceph-mon[34116]: pgmap v215: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:46.992 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:47.119 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:47.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/3303658668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff904115410 msgr2=0x7ff904175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:47.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/3303658668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff904115410 0x7ff904175db0 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=941703563348370479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff90000aa70 tx=0x7ff90002fde0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/3303658668 shutdown_connections 2026-02-19T21:05:47.229 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/3303658668 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff904115410 0x7ff904175db0 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=941703563348370479 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/3303658668 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff90410fbf0 0x7ff904114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/3303658668 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff90410f200 0x7ff90410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/3303658668 >> 10.20.193.90:0/3303658668 conn(0x7ff9040eca60 msgr2=0x7ff90410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/3303658668 shutdown_connections 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/3303658668 wait complete. 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 Processor -- start 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- start start 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 0x7ff9040f4b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff904115410 0x7ff904175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff9040f5130 0x7ff9040fa400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040f5820 con 0x7ff90410f200 2026-02-19T21:05:47.230 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040fa940 con 0x7ff9040f5130 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff90b25f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9040fab00 con 0x7ff904115410 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.225+0000 7ff908fd06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 0x7ff9040f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 0x7ff9040f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43952/0 (socket says 10.20.193.90:43952) 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 -- 10.20.193.90:0/4272930560 learned_addr learned my addr 10.20.193.90:0/4272930560 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff8fbfff6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff904115410 0x7ff904175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff9097d16c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff9040f5130 0x7ff9040fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 -- 10.20.193.90:0/4272930560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff904115410 msgr2=0x7ff904175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff904115410 0x7ff904175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 -- 10.20.193.90:0/4272930560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff9040f5130 msgr2=0x7ff9040fa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff9040f5130 0x7ff9040fa400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 -- 10.20.193.90:0/4272930560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90000a660 con 0x7ff90410f200 2026-02-19T21:05:47.231 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff8fbfff6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff904115410 0x7ff904175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff908fd06c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 0x7ff9040f4b00 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f400b710 tx=0x7ff8f400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f4004250 con 0x7ff90410f200 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff8f4002d80 con 0x7ff90410f200 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9040fade0 con 0x7ff90410f200 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8f400cda0 con 0x7ff90410f200 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9040fb570 con 0x7ff90410f200 2026-02-19T21:05:47.232 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.226+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9041104d0 con 0x7ff90410f200 2026-02-19T21:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.228+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7ff8f40028c0 con 0x7ff90410f200 2026-02-19T21:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.229+0000 7ff8f9ffb6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff8e00b56d0 0x7ff8e00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.229+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ff8f40e3c00 con 0x7ff90410f200 2026-02-19T21:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.229+0000 7ff8fbfff6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff8e00b56d0 0x7ff8e00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.229+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff8f40a9580 con 0x7ff90410f200 2026-02-19T21:05:47.233 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.229+0000 7ff8fbfff6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff8e00b56d0 0x7ff8e00d5b80 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040fb490 tx=0x7ff8ec009060 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:47.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.343+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff9040f5c50 con 0x7ff90410f200 2026-02-19T21:05:47.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.343+0000 7ff8f9ffb6c0 1 -- 10.20.193.90:0/4272930560 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff8f40a9760 con 0x7ff90410f200 2026-02-19T21:05:47.346 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:47.346 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff8e00b56d0 msgr2=0x7ff8e00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff8e00b56d0 0x7ff8e00d5b80 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040fb490 tx=0x7ff8ec009060 comp rx=0 tx=0).stop 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 msgr2=0x7ff9040f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 0x7ff9040f4b00 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8f400b710 tx=0x7ff8f400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 shutdown_connections 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff8e00b56d0 0x7ff8e00d5b80 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff9040f5130 0x7ff9040fa400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff904115410 0x7ff904175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 --2- 10.20.193.90:0/4272930560 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff90410f200 0x7ff9040f4b00 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:47.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 >> 10.20.193.90:0/4272930560 conn(0x7ff9040eca60 msgr2=0x7ff90410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:47.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 shutdown_connections 2026-02-19T21:05:47.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:47.344+0000 7ff90b25f6c0 1 -- 10.20.193.90:0/4272930560 wait complete. 2026-02-19T21:05:47.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:47 trial105 ceph-mon[33883]: pgmap v216: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:47.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:47 trial090 ceph-mon[31759]: pgmap v216: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:47.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:47 trial175 ceph-mon[34116]: pgmap v216: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2026-02-19T21:05:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:48 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4272930560' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:48.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:48 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4272930560' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:48.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:48 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4272930560' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:49.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:49 trial105 ceph-mon[33883]: pgmap v217: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-19T21:05:49.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:49 trial090 ceph-mon[31759]: pgmap v217: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-19T21:05:49.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:49 trial175 ceph-mon[34116]: pgmap v217: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-19T21:05:50.386 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:50.513 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:50.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/1477410988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab810fbf0 msgr2=0x7f2ab8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:50.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/1477410988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab810fbf0 0x7f2ab8114c30 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=14040637932208087858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa80099a0 tx=0x7f2aa802ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:50.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/1477410988 shutdown_connections 2026-02-19T21:05:50.631 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/1477410988 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ab8115410 0x7f2ab8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/1477410988 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab810fbf0 0x7f2ab8114c30 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=14040637932208087858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/1477410988 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ab810f200 0x7f2ab810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/1477410988 >> 10.20.193.90:0/1477410988 conn(0x7f2ab80ecac0 msgr2=0x7f2ab810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/1477410988 shutdown_connections 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/1477410988 wait complete. 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 Processor -- start 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- start start 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ab810f200 0x7f2ab80f4cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 0x7f2ab8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:50.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ab80f52e0 0x7f2ab80fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab80f59d0 con 0x7f2ab8115410 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab80faaa0 con 0x7f2ab80f52e0 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.627+0000 7f2abdeff6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab80fac60 con 0x7f2ab810f200 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 0x7f2ab8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 0x7f2ab8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43976/0 (socket says 10.20.193.90:43976) 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 -- 10.20.193.90:0/2342929847 learned_addr learned my addr 10.20.193.90:0/2342929847 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab7fff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ab80f52e0 0x7f2ab80fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 -- 10.20.193.90:0/2342929847 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ab810f200 msgr2=0x7f2ab80f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ab810f200 0x7f2ab80f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 -- 10.20.193.90:0/2342929847 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ab80f52e0 msgr2=0x7f2ab80fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ab80f52e0 0x7f2ab80fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 -- 10.20.193.90:0/2342929847 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa8009590 con 0x7f2ab8115410 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab6ffd6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 0x7f2ab8175cb0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa8004830 tx=0x7f2aa802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa8002ae0 con 0x7f2ab8115410 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2aa8002c40 con 0x7f2ab8115410 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab80faee0 con 0x7f2ab8115410 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2aa80362f0 con 0x7f2ab8115410 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab80fb380 con 0x7f2ab8115410 2026-02-19T21:05:50.634 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.628+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab81104d0 con 0x7f2ab8115410 2026-02-19T21:05:50.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.630+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f2aa8007810 con 0x7f2ab8115410 2026-02-19T21:05:50.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.630+0000 7f2ab4ff96c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2a8c0b56d0 0x7f2a8c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:50.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.630+0000 7f2ab77fe6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2a8c0b56d0 0x7f2a8c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:50.635 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.630+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2aa8107d50 con 0x7f2ab8115410 2026-02-19T21:05:50.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.631+0000 7f2ab77fe6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2a8c0b56d0 0x7f2a8c0d5b80 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4005980 tx=0x7f2aa4005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:50.636 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.631+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2aa80ca700 con 0x7f2ab8115410 2026-02-19T21:05:50.747 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.745+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2ab810fbf0 con 0x7f2ab8115410 2026-02-19T21:05:50.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.746+0000 7f2ab4ff96c0 1 -- 10.20.193.90:0/2342929847 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2aa80cd8b0 con 0x7f2ab8115410 2026-02-19T21:05:50.748 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:50.748 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:50.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2a8c0b56d0 msgr2=0x7f2a8c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:50.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2a8c0b56d0 0x7f2a8c0d5b80 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa4005980 tx=0x7f2aa4005910 comp rx=0 tx=0).stop 2026-02-19T21:05:50.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 msgr2=0x7f2ab8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 0x7f2ab8175cb0 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa8004830 tx=0x7f2aa802fbf0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 shutdown_connections 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2a8c0b56d0 0x7f2a8c0d5b80 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2ab80f52e0 0x7f2ab80fa560 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2ab8115410 0x7f2ab8175cb0 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 --2- 10.20.193.90:0/2342929847 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2ab810f200 0x7f2ab80f4cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 >> 10.20.193.90:0/2342929847 conn(0x7f2ab80ecac0 msgr2=0x7f2ab8111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 shutdown_connections 2026-02-19T21:05:50.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:50.747+0000 7f2abdeff6c0 1 -- 10.20.193.90:0/2342929847 wait complete. 2026-02-19T21:05:51.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:51 trial105 ceph-mon[33883]: pgmap v218: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:51.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:51 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2342929847' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:51.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:51 trial090 ceph-mon[31759]: pgmap v218: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:51.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:51 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2342929847' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:51.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:51 trial175 ceph-mon[34116]: pgmap v218: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2026-02-19T21:05:51.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:51 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2342929847' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:53.568 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:53 trial175 ceph-mon[34116]: pgmap v219: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-19T21:05:53.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:53 trial105 ceph-mon[33883]: pgmap v219: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-19T21:05:53.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:53 trial090 ceph-mon[31759]: pgmap v219: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2026-02-19T21:05:53.787 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:53.915 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 -- 10.20.193.90:0/366848443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f757810fbf0 msgr2=0x7f7578114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 --2- 10.20.193.90:0/366848443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f757810fbf0 0x7f7578114c30 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=7832347396082914868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f756c0099a0 tx=0x7f756c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 -- 10.20.193.90:0/366848443 shutdown_connections 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 --2- 10.20.193.90:0/366848443 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7578115410 0x7f7578175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 --2- 10.20.193.90:0/366848443 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f757810fbf0 0x7f7578114c30 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=7832347396082914868 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 --2- 10.20.193.90:0/366848443 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f757810f200 0x7f757810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 -- 10.20.193.90:0/366848443 >> 10.20.193.90:0/366848443 conn(0x7f75780eca60 msgr2=0x7f757810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:54.032 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 -- 10.20.193.90:0/366848443 shutdown_connections 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 -- 10.20.193.90:0/366848443 wait complete. 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 Processor -- start 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.027+0000 7f758045f6c0 1 -- start start 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f757810f200 0x7f75780f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 0x7f7578175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f75780f5240 0x7f75780fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75780f5930 con 0x7f7578115410 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75780faa50 con 0x7f757810f200 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75780fac10 con 0x7f75780f5240 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 0x7f7578175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:54.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 0x7f7578175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:32978/0 (socket says 10.20.193.90:32978) 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 -- 10.20.193.90:0/3132213645 learned_addr learned my addr 10.20.193.90:0/3132213645 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757e9d16c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f75780f5240 0x7f75780fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 -- 10.20.193.90:0/3132213645 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f75780f5240 msgr2=0x7f75780fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f75780f5240 0x7f75780fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 -- 10.20.193.90:0/3132213645 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f757810f200 msgr2=0x7f75780f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f757810f200 0x7f75780f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 -- 10.20.193.90:0/3132213645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c009590 con 0x7f7578115410 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757e9d16c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f75780f5240 0x7f75780fa510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f757d9cf6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 0x7f7578175cb0 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f756c004830 tx=0x7f756c02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f756c002ae0 con 0x7f7578115410 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f756c002c40 con 0x7f7578115410 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75780fae90 con 0x7f7578115410 2026-02-19T21:05:54.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f756c0362f0 con 0x7f7578115410 2026-02-19T21:05:54.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75780fb330 con 0x7f7578115410 2026-02-19T21:05:54.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.028+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75781104d0 con 0x7f7578115410 2026-02-19T21:05:54.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.030+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f756c007810 con 0x7f7578115410 2026-02-19T21:05:54.036 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.030+0000 7f755f7fe6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f75540b56d0 0x7f75540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:54.036 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.030+0000 7f757e1d06c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f75540b56d0 0x7f75540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:54.036 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.030+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f756c107cd0 con 0x7f7578115410 2026-02-19T21:05:54.036 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.031+0000 7f757e1d06c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f75540b56d0 0x7f75540d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7568004750 tx=0x7f7568005cb0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:54.036 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.031+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f756c0ca680 con 0x7f7578115410 2026-02-19T21:05:54.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.146+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f757810f5d0 con 0x7f7578115410 2026-02-19T21:05:54.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.146+0000 7f755f7fe6c0 1 -- 10.20.193.90:0/3132213645 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f756c0cd830 con 0x7f7578115410 2026-02-19T21:05:54.149 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:54.149 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:54.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f75540b56d0 msgr2=0x7f75540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:54.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f75540b56d0 0x7f75540d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7568004750 tx=0x7f7568005cb0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 msgr2=0x7f7578175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:54.150 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 0x7f7578175cb0 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f756c004830 tx=0x7f756c02fbf0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 shutdown_connections 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f75540b56d0 0x7f75540d5b80 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f75780f5240 0x7f75780fa510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7578115410 0x7f7578175cb0 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 --2- 10.20.193.90:0/3132213645 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f757810f200 0x7f75780f4c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 >> 10.20.193.90:0/3132213645 conn(0x7f75780eca60 msgr2=0x7f757810d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 shutdown_connections 2026-02-19T21:05:54.151 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:54.148+0000 7f758045f6c0 1 -- 10.20.193.90:0/3132213645 wait complete. 2026-02-19T21:05:54.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:54 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3132213645' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:54.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:54 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3132213645' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:54.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:54 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3132213645' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:55.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:55 trial105 ceph-mon[33883]: pgmap v220: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-19T21:05:55.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:55 trial090 ceph-mon[31759]: pgmap v220: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-19T21:05:55.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:55 trial175 ceph-mon[34116]: pgmap v220: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2026-02-19T21:05:57.189 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:05:57.317 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:05:57.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/2940737207 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810fbf0 msgr2=0x7f7ef8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/2940737207 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810fbf0 0x7f7ef8114c30 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=2538150911930417823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee00099a0 tx=0x7f7ee002ed00 comp rx=0 tx=0).stop 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/2940737207 shutdown_connections 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/2940737207 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7ef8115410 0x7f7ef8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/2940737207 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810fbf0 0x7f7ef8114c30 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=2538150911930417823 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/2940737207 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7ef810f200 0x7f7ef810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/2940737207 >> 10.20.193.90:0/2940737207 conn(0x7f7ef80eca60 msgr2=0x7f7ef810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/2940737207 shutdown_connections 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/2940737207 wait complete. 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 Processor -- start 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- start start 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 0x7f7ef80f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7ef8115410 0x7f7ef8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7ef80f5240 0x7f7ef80fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:57.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80f5930 con 0x7f7ef810f200 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80faa50 con 0x7f7ef8115410 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.437+0000 7f7efca9b6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef80fac10 con 0x7f7ef80f5240 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 0x7f7ef80f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 0x7f7ef80f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:32992/0 (socket says 10.20.193.90:32992) 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 -- 10.20.193.90:0/1640110221 learned_addr learned my addr 10.20.193.90:0/1640110221 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef5d746c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7ef8115410 0x7f7ef8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef6d766c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7ef80f5240 0x7f7ef80fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 -- 10.20.193.90:0/1640110221 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7ef80f5240 msgr2=0x7f7ef80fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7ef80f5240 0x7f7ef80fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 -- 10.20.193.90:0/1640110221 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7ef8115410 msgr2=0x7f7ef8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7ef8115410 0x7f7ef8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 -- 10.20.193.90:0/1640110221 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee0009590 con 0x7f7ef810f200 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7ef65756c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 0x7f7ef80f4c10 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7eec00b6c0 tx=0x7f7eec00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7eec0044a0 con 0x7f7ef810f200 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef80faef0 con 0x7f7ef810f200 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7eec00be50 con 0x7f7ef810f200 2026-02-19T21:05:57.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7eec00cd00 con 0x7f7ef810f200 2026-02-19T21:05:57.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef80fb680 con 0x7f7ef810f200 2026-02-19T21:05:57.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.438+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ef81104d0 con 0x7f7ef810f200 2026-02-19T21:05:57.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.440+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f7eec0026b0 con 0x7f7ef810f200 2026-02-19T21:05:57.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.440+0000 7f7edf7fe6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7ed00b56d0 0x7f7ed00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:05:57.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.440+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f7eec0e39a0 con 0x7f7ef810f200 2026-02-19T21:05:57.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.440+0000 7f7ef5d746c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7ed00b56d0 0x7f7ed00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:05:57.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.441+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7eec0a6420 con 0x7f7ef810f200 2026-02-19T21:05:57.444 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.441+0000 7f7ef5d746c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7ed00b56d0 0x7f7ed00d5b80 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee00092e0 tx=0x7f7ee0031f90 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:05:57.558 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.556+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ef80f5d60 con 0x7f7ef810f200 2026-02-19T21:05:57.558 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:57 trial090 ceph-mon[31759]: pgmap v221: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-19T21:05:57.559 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.556+0000 7f7edf7fe6c0 1 -- 10.20.193.90:0/1640110221 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7eec0a9540 con 0x7f7ef810f200 2026-02-19T21:05:57.559 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:05:57.559 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:05:57.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7ed00b56d0 msgr2=0x7f7ed00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:57.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7ed00b56d0 0x7f7ed00d5b80 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ee00092e0 tx=0x7f7ee0031f90 comp rx=0 tx=0).stop 2026-02-19T21:05:57.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 msgr2=0x7f7ef80f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:05:57.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 0x7f7ef80f4c10 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7eec00b6c0 tx=0x7f7eec00bb90 comp rx=0 tx=0).stop 2026-02-19T21:05:57.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 shutdown_connections 2026-02-19T21:05:57.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7ed00b56d0 0x7f7ed00d5b80 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7ef80f5240 0x7f7ef80fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7ef8115410 0x7f7ef8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 --2- 10.20.193.90:0/1640110221 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7ef810f200 0x7f7ef80f4c10 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:05:57.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 >> 10.20.193.90:0/1640110221 conn(0x7f7ef80eca60 msgr2=0x7f7ef810d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:05:57.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 shutdown_connections 2026-02-19T21:05:57.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:05:57.557+0000 7f7efca9b6c0 1 -- 10.20.193.90:0/1640110221 wait complete. 2026-02-19T21:05:57.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:57 trial105 ceph-mon[33883]: pgmap v221: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-19T21:05:57.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:57 trial175 ceph-mon[34116]: pgmap v221: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 0 B/s wr, 5 op/s 2026-02-19T21:05:58.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:58 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1640110221' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:58.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:58 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1640110221' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:58.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:58 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1640110221' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:05:59.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:05:59 trial105 ceph-mon[33883]: pgmap v222: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-19T21:05:59.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:05:59 trial090 ceph-mon[31759]: pgmap v222: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-19T21:05:59.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:05:59 trial175 ceph-mon[34116]: pgmap v222: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.6 KiB/s rd, 5 op/s 2026-02-19T21:06:00.599 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:00.727 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:00.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/2625583911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 msgr2=0x7f56c4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/2625583911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c4175db0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=14507500334502989702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b400aa70 tx=0x7f56b402fde0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/2625583911 shutdown_connections 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/2625583911 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c4175db0 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=14507500334502989702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/2625583911 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f56c410fbf0 0x7f56c4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/2625583911 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f56c410f200 0x7f56c410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/2625583911 >> 10.20.193.90:0/2625583911 conn(0x7f56c40eca60 msgr2=0x7f56c410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/2625583911 shutdown_connections 2026-02-19T21:06:00.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.844+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/2625583911 wait complete. 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 Processor -- start 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 -- start start 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f56c410f200 0x7f56c411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f56c4122b90 0x7f56c4123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56c41235a0 con 0x7f56c4115410 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56c4123710 con 0x7f56c410f200 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56c41238d0 con 0x7f56c4122b90 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33004/0 (socket says 10.20.193.90:33004) 2026-02-19T21:06:00.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 -- 10.20.193.90:0/4148004877 learned_addr learned my addr 10.20.193.90:0/4148004877 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c25756c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f56c410f200 0x7f56c411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c2d766c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f56c4122b90 0x7f56c4123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 -- 10.20.193.90:0/4148004877 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f56c4122b90 msgr2=0x7f56c4123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f56c4122b90 0x7f56c4123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 -- 10.20.193.90:0/4148004877 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f56c410f200 msgr2=0x7f56c411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f56c410f200 0x7f56c411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 -- 10.20.193.90:0/4148004877 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b400a660 con 0x7f56c4115410 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c1d746c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c411d7d0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac005dc0 tx=0x7f56ac00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ac004250 con 0x7f56c4115410 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f56ac009070 con 0x7f56c4115410 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c4163d80 con 0x7f56c4115410 2026-02-19T21:06:00.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56ac00cd50 con 0x7f56c4115410 2026-02-19T21:06:00.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.845+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c4164260 con 0x7f56c4115410 2026-02-19T21:06:00.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.846+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c41104d0 con 0x7f56c4115410 2026-02-19T21:06:00.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.847+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f56ac0028c0 con 0x7f56c4115410 2026-02-19T21:06:00.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.847+0000 7f56ab7fe6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f569c0b56d0 0x7f569c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:00.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.847+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f56ac0e3b20 con 0x7f56c4115410 2026-02-19T21:06:00.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.847+0000 7f56c25756c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f569c0b56d0 0x7f569c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:00.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.848+0000 7f56c25756c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f569c0b56d0 0x7f569c0d5b80 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b8005980 tx=0x7f56b8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:00.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.848+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f56ac0a64d0 con 0x7f56c4115410 2026-02-19T21:06:00.963 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.961+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f56c411e3e0 con 0x7f56c4115410 2026-02-19T21:06:00.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.961+0000 7f56ab7fe6c0 1 -- 10.20.193.90:0/4148004877 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f56ac0a9680 con 0x7f56c4115410 2026-02-19T21:06:00.964 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:00.964 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:00.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f569c0b56d0 msgr2=0x7f569c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:00.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f569c0b56d0 0x7f569c0d5b80 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56b8005980 tx=0x7f56b8005910 comp rx=0 tx=0).stop 2026-02-19T21:06:00.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 msgr2=0x7f56c411d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:00.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c411d7d0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f56ac005dc0 tx=0x7f56ac00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 shutdown_connections 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f569c0b56d0 0x7f569c0d5b80 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f56c4122b90 0x7f56c4123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f56c4115410 0x7f56c411d7d0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 --2- 10.20.193.90:0/4148004877 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f56c410f200 0x7f56c411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 >> 10.20.193.90:0/4148004877 conn(0x7f56c40eca60 msgr2=0x7f56c410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 shutdown_connections 2026-02-19T21:06:00.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:00.962+0000 7f56c8eec6c0 1 -- 10.20.193.90:0/4148004877 wait complete. 2026-02-19T21:06:01.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:01 trial105 ceph-mon[33883]: pgmap v223: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:01.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:01 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4148004877' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:01 trial090 ceph-mon[31759]: pgmap v223: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:01.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:01 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4148004877' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:01.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:01 trial175 ceph-mon[34116]: pgmap v223: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:01.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:01 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4148004877' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:03.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:03 trial105 ceph-mon[33883]: pgmap v224: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:03.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:03 trial090 ceph-mon[31759]: pgmap v224: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:03.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:03 trial175 ceph-mon[34116]: pgmap v224: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:04.005 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:04.129 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 -- 10.20.193.90:0/1039399272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d00113160 msgr2=0x7f7d00173b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/1039399272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d00113160 0x7f7d00173b00 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=18344087401608820870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cfc00aa70 tx=0x7f7cfc02fde0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 -- 10.20.193.90:0/1039399272 shutdown_connections 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/1039399272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d00113160 0x7f7d00173b00 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=18344087401608820870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/1039399272 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d0010d940 0x7f7d00112980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/1039399272 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7d0010cf50 0x7f7d0010d320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 -- 10.20.193.90:0/1039399272 >> 10.20.193.90:0/1039399272 conn(0x7f7d000ea870 msgr2=0x7f7d0010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 -- 10.20.193.90:0/1039399272 shutdown_connections 2026-02-19T21:06:04.241 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.239+0000 7f7d07e206c0 1 -- 10.20.193.90:0/1039399272 wait complete. 2026-02-19T21:06:04.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 Processor -- start 2026-02-19T21:06:04.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 -- start start 2026-02-19T21:06:04.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 0x7f7d000f4b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:04.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7d00113160 0x7f7d00173a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:04.242 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d000f51a0 0x7f7d000fa470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7d000f5890 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d000fa9b0 con 0x7f7d000f51a0 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7d000fab70 con 0x7f7d00113160 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 0x7f7d000f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 0x7f7d000f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48308/0 (socket says 10.20.193.90:48308) 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 -- 10.20.193.90:0/2850495709 learned_addr learned my addr 10.20.193.90:0/2850495709 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d063966c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d000f51a0 0x7f7d000fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 -- 10.20.193.90:0/2850495709 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7d00113160 msgr2=0x7f7d00173a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7d00113160 0x7f7d00173a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 -- 10.20.193.90:0/2850495709 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d000f51a0 msgr2=0x7f7d000fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d000f51a0 0x7f7d000fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 -- 10.20.193.90:0/2850495709 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc00a660 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d063966c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d000f51a0 0x7f7d000fa470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d05b956c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 0x7f7d000f4b70 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf000b710 tx=0x7f7cf000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf0004250 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7cf0009070 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d000fae50 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7cf000ccd0 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.240+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d000fb5e0 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.241+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0010e220 con 0x7f7d0010cf50 2026-02-19T21:06:04.243 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.242+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f7cf00028c0 con 0x7f7d0010cf50 2026-02-19T21:06:04.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.243+0000 7f7ceeffd6c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7cdc0b5650 0x7f7cdc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:04.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.243+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f7cf00e3d40 con 0x7f7d0010cf50 2026-02-19T21:06:04.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.243+0000 7f7d053946c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7cdc0b5650 0x7f7cdc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:04.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.243+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7cf00a66f0 con 0x7f7d0010cf50 2026-02-19T21:06:04.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.243+0000 7f7d053946c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7cdc0b5650 0x7f7cdc0d5b00 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf4005980 tx=0x7f7cf4005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:04.359 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.357+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7d000f5cc0 con 0x7f7d0010cf50 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.358+0000 7f7ceeffd6c0 1 -- 10.20.193.90:0/2850495709 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7cf000ce60 con 0x7f7d0010cf50 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7cdc0b5650 msgr2=0x7f7cdc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7cdc0b5650 0x7f7cdc0d5b00 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf4005980 tx=0x7f7cf4005910 comp rx=0 tx=0).stop 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 msgr2=0x7f7d000f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 0x7f7d000f4b70 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cf000b710 tx=0x7f7cf000bbe0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 shutdown_connections 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7cdc0b5650 0x7f7cdc0d5b00 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7d000f51a0 0x7f7d000fa470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7d00113160 0x7f7d00173a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 --2- 10.20.193.90:0/2850495709 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7d0010cf50 0x7f7d000f4b70 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 >> 10.20.193.90:0/2850495709 conn(0x7f7d000ea870 msgr2=0x7f7d0010b490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 shutdown_connections 2026-02-19T21:06:04.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:04.359+0000 7f7d07e206c0 1 -- 10.20.193.90:0/2850495709 wait complete. 2026-02-19T21:06:05.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:05 trial105 ceph-mon[33883]: pgmap v225: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:05.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:05 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2850495709' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:05 trial090 ceph-mon[31759]: pgmap v225: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:05.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:05 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2850495709' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:05.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:05 trial175 ceph-mon[34116]: pgmap v225: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:05.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:05 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2850495709' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:06.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:06 trial105 ceph-mon[33883]: pgmap v226: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:06 trial090 ceph-mon[31759]: pgmap v226: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:06.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:06 trial175 ceph-mon[34116]: pgmap v226: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:07.399 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:07.524 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:07.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3665637573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b810f200 msgr2=0x7f53b810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:07.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3665637573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b810f200 0x7f53b810f5d0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=4695895036713410140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53ac0099a0 tx=0x7f53ac02ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:07.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3665637573 shutdown_connections 2026-02-19T21:06:07.642 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3665637573 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f53b8115410 0x7f53b8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3665637573 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f53b810fbf0 0x7f53b8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3665637573 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b810f200 0x7f53b810f5d0 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=4695895036713410140 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3665637573 >> 10.20.193.90:0/3665637573 conn(0x7f53b80ecac0 msgr2=0x7f53b810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3665637573 shutdown_connections 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3665637573 wait complete. 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.638+0000 7f53bd4316c0 1 Processor -- start 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 -- start start 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f53b810f200 0x7f53b811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f53b8115410 0x7f53b811d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 0x7f53b81230d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:07.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8123610 con 0x7f53b8122c30 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8123780 con 0x7f53b810f200 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53b8123940 con 0x7f53b8115410 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 0x7f53b81230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 0x7f53b81230d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48316/0 (socket says 10.20.193.90:48316) 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 -- 10.20.193.90:0/3165118291 learned_addr learned my addr 10.20.193.90:0/3165118291 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b67fc6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f53b8115410 0x7f53b811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b6ffd6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f53b810f200 0x7f53b811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 -- 10.20.193.90:0/3165118291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f53b8115410 msgr2=0x7f53b811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f53b8115410 0x7f53b811d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 -- 10.20.193.90:0/3165118291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f53b810f200 msgr2=0x7f53b811d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f53b810f200 0x7f53b811d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.644 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 -- 10.20.193.90:0/3165118291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ac009590 con 0x7f53b8122c30 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53b77fe6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 0x7f53b81230d0 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53a8006ea0 tx=0x7f53a800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53a8003a30 con 0x7f53b8122c30 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b8163dc0 con 0x7f53b8122c30 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f53a80054f0 con 0x7f53b8122c30 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53a800dcd0 con 0x7f53b8122c30 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.639+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b81642f0 con 0x7f53b8122c30 2026-02-19T21:06:07.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.640+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b81104d0 con 0x7f53b8122c30 2026-02-19T21:06:07.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.641+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f53a8005030 con 0x7f53b8122c30 2026-02-19T21:06:07.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.641+0000 7f5397fff6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f538c0b56d0 0x7f538c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:07.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.641+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f53a80e4bf0 con 0x7f53b8122c30 2026-02-19T21:06:07.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.641+0000 7f53b6ffd6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f538c0b56d0 0x7f538c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:07.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.642+0000 7f53b6ffd6c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f538c0b56d0 0x7f538c0d5b80 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53ac0092e0 tx=0x7f53ac005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:07.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.642+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f53a80a75a0 con 0x7f53b8122c30 2026-02-19T21:06:07.759 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.757+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f53b811e480 con 0x7f53b8122c30 2026-02-19T21:06:07.760 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.757+0000 7f5397fff6c0 1 -- 10.20.193.90:0/3165118291 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f53a800de60 con 0x7f53b8122c30 2026-02-19T21:06:07.760 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:07.760 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:07.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.758+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f538c0b56d0 msgr2=0x7f538c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:07.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.758+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f538c0b56d0 0x7f538c0d5b80 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53ac0092e0 tx=0x7f53ac005c00 comp rx=0 tx=0).stop 2026-02-19T21:06:07.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.758+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 msgr2=0x7f53b81230d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:07.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.758+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 0x7f53b81230d0 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f53a8006ea0 tx=0x7f53a800cca0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 shutdown_connections 2026-02-19T21:06:07.761 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f538c0b56d0 0x7f538c0d5b80 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f53b8122c30 0x7f53b81230d0 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f53b8115410 0x7f53b811d870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 --2- 10.20.193.90:0/3165118291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f53b810f200 0x7f53b811d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:07.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 >> 10.20.193.90:0/3165118291 conn(0x7f53b80ecac0 msgr2=0x7f53b810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:07.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 shutdown_connections 2026-02-19T21:06:07.762 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:07.759+0000 7f53bd4316c0 1 -- 10.20.193.90:0/3165118291 wait complete. 2026-02-19T21:06:08.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:07 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3165118291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:08.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:07 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3165118291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:08.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:07 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3165118291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:09.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:08 trial105 ceph-mon[33883]: pgmap v227: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:09.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:08 trial090 ceph-mon[31759]: pgmap v227: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:09.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:08 trial175 ceph-mon[34116]: pgmap v227: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:10.800 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:10.925 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:11.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/761366549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810fbf0 msgr2=0x7f6d58114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/761366549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810fbf0 0x7f6d58114c30 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=13890494559699714699 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d480099a0 tx=0x7f6d4802ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/761366549 shutdown_connections 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/761366549 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6d58115410 0x7f6d58175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/761366549 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810fbf0 0x7f6d58114c30 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=13890494559699714699 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/761366549 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6d5810f200 0x7f6d5810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/761366549 >> 10.20.193.90:0/761366549 conn(0x7f6d580eca60 msgr2=0x7f6d5810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:11.040 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/761366549 shutdown_connections 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/761366549 wait complete. 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 Processor -- start 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- start start 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 0x7f6d580f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6d58115410 0x7f6d58175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6d580f5240 0x7f6d580fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580f5930 con 0x7f6d5810f200 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580faa50 con 0x7f6d580f5240 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d5dad46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d580fac10 con 0x7f6d58115410 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 0x7f6d580f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 0x7f6d580f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48332/0 (socket says 10.20.193.90:48332) 2026-02-19T21:06:11.041 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 -- 10.20.193.90:0/2264424684 learned_addr learned my addr 10.20.193.90:0/2264424684 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d56ffd6c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6d58115410 0x7f6d58175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 -- 10.20.193.90:0/2264424684 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6d58115410 msgr2=0x7f6d58175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6d58115410 0x7f6d58175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 -- 10.20.193.90:0/2264424684 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6d580f5240 msgr2=0x7f6d580fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6d580f5240 0x7f6d580fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.036+0000 7f6d577fe6c0 1 -- 10.20.193.90:0/2264424684 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d48009590 con 0x7f6d5810f200 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d577fe6c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 0x7f6d580f4c10 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4400b710 tx=0x7f6d4400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d44004250 con 0x7f6d5810f200 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6d44002d80 con 0x7f6d5810f200 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d580faef0 con 0x7f6d5810f200 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6d4400cda0 con 0x7f6d5810f200 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d580fb680 con 0x7f6d5810f200 2026-02-19T21:06:11.042 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.037+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d581104d0 con 0x7f6d5810f200 2026-02-19T21:06:11.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.039+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f6d440028c0 con 0x7f6d5810f200 2026-02-19T21:06:11.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.039+0000 7f6d54ff96c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d2c0b56d0 0x7f6d2c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:11.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.039+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f6d440e3c00 con 0x7f6d5810f200 2026-02-19T21:06:11.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.039+0000 7f6d56ffd6c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d2c0b56d0 0x7f6d2c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:11.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.039+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6d4411c660 con 0x7f6d5810f200 2026-02-19T21:06:11.044 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.040+0000 7f6d56ffd6c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d2c0b56d0 0x7f6d2c0d5b80 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d48005b40 tx=0x7f6d48005c20 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:11.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.153+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6d5810f5d0 con 0x7f6d5810f200 2026-02-19T21:06:11.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.153+0000 7f6d54ff96c0 1 -- 10.20.193.90:0/2264424684 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6d440a65b0 con 0x7f6d5810f200 2026-02-19T21:06:11.155 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:11.155 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:11.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d2c0b56d0 msgr2=0x7f6d2c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d2c0b56d0 0x7f6d2c0d5b80 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d48005b40 tx=0x7f6d48005c20 comp rx=0 tx=0).stop 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 msgr2=0x7f6d580f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 0x7f6d580f4c10 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4400b710 tx=0x7f6d4400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 shutdown_connections 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f6d2c0b56d0 0x7f6d2c0d5b80 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6d580f5240 0x7f6d580fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6d58115410 0x7f6d58175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 --2- 10.20.193.90:0/2264424684 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6d5810f200 0x7f6d580f4c10 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 >> 10.20.193.90:0/2264424684 conn(0x7f6d580eca60 msgr2=0x7f6d5810d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.154+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 shutdown_connections 2026-02-19T21:06:11.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:11.155+0000 7f6d5dad46c0 1 -- 10.20.193.90:0/2264424684 wait complete. 2026-02-19T21:06:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:11 trial090 ceph-mon[31759]: pgmap v228: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:11.407 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:11 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2264424684' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:11.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:11 trial105 ceph-mon[33883]: pgmap v228: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:11.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:11 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2264424684' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:11.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:11 trial175 ceph-mon[34116]: pgmap v228: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:11.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:11 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2264424684' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:13.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:13 trial105 ceph-mon[33883]: pgmap v229: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:13.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:13 trial090 ceph-mon[31759]: pgmap v229: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:13.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:13 trial175 ceph-mon[34116]: pgmap v229: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:14.195 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:14.321 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:14.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2353479236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c060760 msgr2=0x7f4d7c060b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:14.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2353479236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c060760 0x7f4d7c060b30 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=11899273519236271209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d68009970 tx=0x7f4d6802ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:14.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2353479236 shutdown_connections 2026-02-19T21:06:14.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2353479236 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d7c155610 0x7f4d7c1759f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2353479236 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d7c061070 0x7f4d7c1550d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2353479236 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c060760 0x7f4d7c060b30 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=11899273519236271209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2353479236 >> 10.20.193.90:0/2353479236 conn(0x7f4d7c0ea840 msgr2=0x7f4d7c10ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2353479236 shutdown_connections 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.437+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2353479236 wait complete. 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 Processor -- start 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 -- start start 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d7c060760 0x7f4d7c161490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d7c061070 0x7f4d7c1619d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 0x7f4d7c166d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c1673e0 con 0x7f4d7c155610 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c167550 con 0x7f4d7c061070 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c167710 con 0x7f4d7c060760 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 0x7f4d7c166d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 0x7f4d7c166d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43074/0 (socket says 10.20.193.90:43074) 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 -- 10.20.193.90:0/2427267861 learned_addr learned my addr 10.20.193.90:0/2427267861 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d7b7fe6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d7c061070 0x7f4d7c1619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d7bfff6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d7c060760 0x7f4d7c161490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 -- 10.20.193.90:0/2427267861 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d7c060760 msgr2=0x7f4d7c161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d7c060760 0x7f4d7c161490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 -- 10.20.193.90:0/2427267861 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d7c061070 msgr2=0x7f4d7c1619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d7c061070 0x7f4d7c1619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 -- 10.20.193.90:0/2427267861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d68009590 con 0x7f4d7c155610 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d80d616c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 0x7f4d7c166d90 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d7000c710 tx=0x7f4d7000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:14.441 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d70003a30 con 0x7f4d7c155610 2026-02-19T21:06:14.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4d700054f0 con 0x7f4d7c155610 2026-02-19T21:06:14.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c1679f0 con 0x7f4d7c155610 2026-02-19T21:06:14.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d7000dc00 con 0x7f4d7c155610 2026-02-19T21:06:14.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.438+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c151240 con 0x7f4d7c155610 2026-02-19T21:06:14.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.439+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c061c70 con 0x7f4d7c155610 2026-02-19T21:06:14.442 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.440+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f4d70005030 con 0x7f4d7c155610 2026-02-19T21:06:14.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.441+0000 7f4d797fa6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d500b56d0 0x7f4d500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:14.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.441+0000 7f4d7bfff6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d500b56d0 0x7f4d500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:14.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.441+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f4d700e4b90 con 0x7f4d7c155610 2026-02-19T21:06:14.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.441+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d7011d660 con 0x7f4d7c155610 2026-02-19T21:06:14.443 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.441+0000 7f4d7bfff6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d500b56d0 0x7f4d500d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d68005b40 tx=0x7f4d68005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:14.560 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.559+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d7c060b30 con 0x7f4d7c155610 2026-02-19T21:06:14.561 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.559+0000 7f4d797fa6c0 1 -- 10.20.193.90:0/2427267861 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d700a7580 con 0x7f4d7c155610 2026-02-19T21:06:14.561 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:14.561 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:14.562 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d500b56d0 msgr2=0x7f4d500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:14.562 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d500b56d0 0x7f4d500d5b80 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d68005b40 tx=0x7f4d68005c00 comp rx=0 tx=0).stop 2026-02-19T21:06:14.562 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 msgr2=0x7f4d7c166d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:14.562 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 0x7f4d7c166d90 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d7000c710 tx=0x7f4d7000cbe0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.562 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 shutdown_connections 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d500b56d0 0x7f4d500d5b80 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d7c155610 0x7f4d7c166d90 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d7c061070 0x7f4d7c1619d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 --2- 10.20.193.90:0/2427267861 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d7c060760 0x7f4d7c161490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 >> 10.20.193.90:0/2427267861 conn(0x7f4d7c0ea840 msgr2=0x7f4d7c10ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 shutdown_connections 2026-02-19T21:06:14.563 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:14.561+0000 7f4d827ef6c0 1 -- 10.20.193.90:0/2427267861 wait complete. 2026-02-19T21:06:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:15 trial105 ceph-mon[33883]: pgmap v230: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:15 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2427267861' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:15.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:15 trial090 ceph-mon[31759]: pgmap v230: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:15.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:15 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2427267861' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:15 trial175 ceph-mon[34116]: pgmap v230: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:15.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:15 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2427267861' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:17.602 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:17.631 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:17 trial090 ceph-mon[31759]: pgmap v231: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:17.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:17 trial105 ceph-mon[33883]: pgmap v231: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:17.731 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:17.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:17 trial175 ceph-mon[34116]: pgmap v231: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:17.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 -- 10.20.193.90:0/3745401423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 msgr2=0x7f94b010d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/3745401423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b010d340 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=3458420571758630594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a00099a0 tx=0x7f94a002ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 -- 10.20.193.90:0/3745401423 shutdown_connections 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/3745401423 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 0x7f94b0173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/3745401423 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b010d960 0x7f94b01129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/3745401423 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b010d340 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=3458420571758630594 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 -- 10.20.193.90:0/3745401423 >> 10.20.193.90:0/3745401423 conn(0x7f94b00ea870 msgr2=0x7f94b010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 -- 10.20.193.90:0/3745401423 shutdown_connections 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.846+0000 7f94b70f96c0 1 -- 10.20.193.90:0/3745401423 wait complete. 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 Processor -- start 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 -- start start 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b00606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 0x7f94b0060c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b0061140 0x7f94b01632c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0163800 con 0x7f94b010cf70 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0163970 con 0x7f94b0113180 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0163b30 con 0x7f94b0061140 2026-02-19T21:06:17.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b00606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b00606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43104/0 (socket says 10.20.193.90:43104) 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 -- 10.20.193.90:0/1425912803 learned_addr learned my addr 10.20.193.90:0/1425912803 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94a7fff6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 0x7f94b0060c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 -- 10.20.193.90:0/1425912803 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b0061140 msgr2=0x7f94b01632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b566b6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b0061140 0x7f94b01632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b0061140 0x7f94b01632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 -- 10.20.193.90:0/1425912803 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 msgr2=0x7f94b0060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 0x7f94b0060c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 -- 10.20.193.90:0/1425912803 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a0009590 con 0x7f94b010cf70 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94a7fff6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 0x7f94b0060c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b566b6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b0061140 0x7f94b01632c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b4e6a6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b00606c0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a002f230 tx=0x7f94a002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94a0002c20 con 0x7f94b010cf70 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f94a0002d80 con 0x7f94b010cf70 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b0163db0 con 0x7f94b010cf70 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94a00372f0 con 0x7f94b010cf70 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.847+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b0164280 con 0x7f94b010cf70 2026-02-19T21:06:17.851 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.848+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b010e240 con 0x7f94b010cf70 2026-02-19T21:06:17.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.849+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f94a00079a0 con 0x7f94b010cf70 2026-02-19T21:06:17.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.849+0000 7f94a5ffb6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f948c0b56d0 0x7f948c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:17.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.850+0000 7f94a7fff6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f948c0b56d0 0x7f948c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:17.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.850+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f94a0107e50 con 0x7f94b010cf70 2026-02-19T21:06:17.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.850+0000 7f94a7fff6c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f948c0b56d0 0x7f948c0d5b80 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b010fa90 tx=0x7f9498006e70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:17.852 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.850+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94a00ca8d0 con 0x7f94b010cf70 2026-02-19T21:06:17.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.964+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94b00619c0 con 0x7f94b010cf70 2026-02-19T21:06:17.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.964+0000 7f94a5ffb6c0 1 -- 10.20.193.90:0/1425912803 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f94a00cd9f0 con 0x7f94b010cf70 2026-02-19T21:06:17.967 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:17.967 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f948c0b56d0 msgr2=0x7f948c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f948c0b56d0 0x7f948c0d5b80 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94b010fa90 tx=0x7f9498006e70 comp rx=0 tx=0).stop 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 msgr2=0x7f94b00606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b00606c0 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94a002f230 tx=0x7f94a002fd40 comp rx=0 tx=0).stop 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 shutdown_connections 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f948c0b56d0 0x7f948c0d5b80 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f94b0061140 0x7f94b01632c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f94b0113180 0x7f94b0060c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 --2- 10.20.193.90:0/1425912803 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f94b010cf70 0x7f94b00606c0 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:17.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 >> 10.20.193.90:0/1425912803 conn(0x7f94b00ea870 msgr2=0x7f94b010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:17.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 shutdown_connections 2026-02-19T21:06:17.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:17.965+0000 7f94b70f96c0 1 -- 10.20.193.90:0/1425912803 wait complete. 2026-02-19T21:06:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:18 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1425912803' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:18 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1425912803' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:18.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:18 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1425912803' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:19.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:19 trial105 ceph-mon[33883]: pgmap v232: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:19.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:19 trial090 ceph-mon[31759]: pgmap v232: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:19 trial175 ceph-mon[34116]: pgmap v232: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:21.007 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:21.133 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/1761463852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a410d960 msgr2=0x7fa6a41129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/1761463852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a410d960 0x7fa6a41129a0 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=14113301786192966435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa68c0099a0 tx=0x7fa68c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/1761463852 shutdown_connections 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/1761463852 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a4113180 0x7fa6a4173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/1761463852 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a410d960 0x7fa6a41129a0 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=14113301786192966435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/1761463852 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa6a410cf70 0x7fa6a410d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/1761463852 >> 10.20.193.90:0/1761463852 conn(0x7fa6a40ea870 msgr2=0x7fa6a410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/1761463852 shutdown_connections 2026-02-19T21:06:21.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.244+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/1761463852 wait complete. 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 Processor -- start 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 -- start start 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a410cf70 0x7fa6a40f3490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 0x7fa6a4173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa6a40f3ac0 0x7fa6a40f8d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40f41b0 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40f92d0 con 0x7fa6a40f3ac0 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a40f9490 con 0x7fa6a410cf70 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 0x7fa6a4173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 0x7fa6a4173a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43116/0 (socket says 10.20.193.90:43116) 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 -- 10.20.193.90:0/4014315037 learned_addr learned my addr 10.20.193.90:0/4014315037 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6a95da6c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa6a40f3ac0 0x7fa6a40f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6a8dd96c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a410cf70 0x7fa6a40f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 -- 10.20.193.90:0/4014315037 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a410cf70 msgr2=0x7fa6a40f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a410cf70 0x7fa6a40f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 -- 10.20.193.90:0/4014315037 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa6a40f3ac0 msgr2=0x7fa6a40f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa6a40f3ac0 0x7fa6a40f8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 -- 10.20.193.90:0/4014315037 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c009590 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6a8dd96c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a410cf70 0x7fa6a40f3490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa69bfff6c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 0x7fa6a4173a20 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa68c0023c0 tx=0x7fa68c02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa68c002ae0 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa68c002c40 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa68c0372f0 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a40f9710 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.245+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a40f9b40 con 0x7fa6a4113180 2026-02-19T21:06:21.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.246+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a410e240 con 0x7fa6a4113180 2026-02-19T21:06:21.248 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.247+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fa68c007810 con 0x7fa6a4113180 2026-02-19T21:06:21.249 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.248+0000 7fa699ffb6c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa6740b56d0 0x7fa6740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:21.249 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.248+0000 7fa6a8dd96c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa6740b56d0 0x7fa6740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:21.249 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.248+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fa68c107ca0 con 0x7fa6a4113180 2026-02-19T21:06:21.249 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.248+0000 7fa6a8dd96c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa6740b56d0 0x7fa6740d5b80 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa694004750 tx=0x7fa694005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:21.250 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.248+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa68c0ca650 con 0x7fa6a4113180 2026-02-19T21:06:21.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.363+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa6a410d960 con 0x7fa6a4113180 2026-02-19T21:06:21.366 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.364+0000 7fa699ffb6c0 1 -- 10.20.193.90:0/4014315037 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa68c007e60 con 0x7fa6a4113180 2026-02-19T21:06:21.366 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:21.366 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:21.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa6740b56d0 msgr2=0x7fa6740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:21.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa6740b56d0 0x7fa6740d5b80 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa694004750 tx=0x7fa694005f10 comp rx=0 tx=0).stop 2026-02-19T21:06:21.367 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 msgr2=0x7fa6a4173a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 0x7fa6a4173a20 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa68c0023c0 tx=0x7fa68c02fbf0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 shutdown_connections 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa6740b56d0 0x7fa6740d5b80 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa6a40f3ac0 0x7fa6a40f8d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa6a4113180 0x7fa6a4173a20 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 --2- 10.20.193.90:0/4014315037 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa6a410cf70 0x7fa6a40f3490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 >> 10.20.193.90:0/4014315037 conn(0x7fa6a40ea870 msgr2=0x7fa6a410f760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 shutdown_connections 2026-02-19T21:06:21.368 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:21.365+0000 7fa6ab0686c0 1 -- 10.20.193.90:0/4014315037 wait complete. 2026-02-19T21:06:21.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:21 trial105 ceph-mon[33883]: pgmap v233: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:21.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:21 trial090 ceph-mon[31759]: pgmap v233: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:21.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:21 trial175 ceph-mon[34116]: pgmap v233: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:22.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:22 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4014315037' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:22 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4014315037' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:22.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:22 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4014315037' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:23.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:23 trial105 ceph-mon[33883]: pgmap v234: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:23.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:23 trial090 ceph-mon[31759]: pgmap v234: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:23.666 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:23 trial175 ceph-mon[34116]: pgmap v234: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:24.405 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:24.535 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 -- 10.20.193.90:0/4000877992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788115410 msgr2=0x7f4788175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/4000877992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788115410 0x7f4788175db0 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=11261185126889456592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f477c00aa70 tx=0x7f477c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 -- 10.20.193.90:0/4000877992 shutdown_connections 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/4000877992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788115410 0x7f4788175db0 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=11261185126889456592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/4000877992 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810fbf0 0x7f4788114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/4000877992 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f478810f200 0x7f478810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 -- 10.20.193.90:0/4000877992 >> 10.20.193.90:0/4000877992 conn(0x7f47880eca60 msgr2=0x7f478810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:24.657 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 -- 10.20.193.90:0/4000877992 shutdown_connections 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.652+0000 7f478e4b36c0 1 -- 10.20.193.90:0/4000877992 wait complete. 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 Processor -- start 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 -- start start 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810f200 0x7f478811d270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4788115410 0x7f478811d7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 0x7f4788123010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4788123580 con 0x7f4788122b70 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47881236f0 con 0x7f4788115410 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f47881238b0 con 0x7f478810f200 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 0x7f4788123010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 0x7f4788123010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43572/0 (socket says 10.20.193.90:43572) 2026-02-19T21:06:24.658 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 -- 10.20.193.90:0/398908591 learned_addr learned my addr 10.20.193.90:0/398908591 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f4787fff6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810f200 0x7f478811d270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f47877fe6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4788115410 0x7f478811d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 -- 10.20.193.90:0/398908591 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810f200 msgr2=0x7f478811d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810f200 0x7f478811d270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 -- 10.20.193.90:0/398908591 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4788115410 msgr2=0x7f478811d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4788115410 0x7f478811d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 -- 10.20.193.90:0/398908591 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c00a660 con 0x7f4788122b70 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f4787fff6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810f200 0x7f478811d270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f47877fe6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4788115410 0x7f478811d7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478ca256c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 0x7f4788123010 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f477c0054b0 tx=0x7f477c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f477c003a30 con 0x7f4788122b70 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f477c003b90 con 0x7f4788122b70 2026-02-19T21:06:24.659 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4788163d00 con 0x7f4788122b70 2026-02-19T21:06:24.660 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f477c0382f0 con 0x7f4788122b70 2026-02-19T21:06:24.660 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.653+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4788164130 con 0x7f4788122b70 2026-02-19T21:06:24.660 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.654+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47881104d0 con 0x7f4788122b70 2026-02-19T21:06:24.660 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.655+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f477c008260 con 0x7f4788122b70 2026-02-19T21:06:24.661 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.656+0000 7f47857fa6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f475c0b56d0 0x7f475c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:24.661 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.656+0000 7f4787fff6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f475c0b56d0 0x7f475c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:24.661 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.656+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f477c108fb0 con 0x7f4788122b70 2026-02-19T21:06:24.661 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.656+0000 7f4787fff6c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f475c0b56d0 0x7f475c0d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4774004750 tx=0x7f4774006e70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:24.661 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.656+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f477c0cf3c0 con 0x7f4788122b70 2026-02-19T21:06:24.771 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.769+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f478811e3c0 con 0x7f4788122b70 2026-02-19T21:06:24.772 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.769+0000 7f47857fa6c0 1 -- 10.20.193.90:0/398908591 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f477c0ceb10 con 0x7f4788122b70 2026-02-19T21:06:24.772 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:24.773 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:24.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f475c0b56d0 msgr2=0x7f475c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:24.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f475c0b56d0 0x7f475c0d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4774004750 tx=0x7f4774006e70 comp rx=0 tx=0).stop 2026-02-19T21:06:24.774 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 msgr2=0x7f4788123010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:24.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 0x7f4788123010 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f477c0054b0 tx=0x7f477c0054e0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 shutdown_connections 2026-02-19T21:06:24.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f475c0b56d0 0x7f475c0d5b80 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4788122b70 0x7f4788123010 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.775 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4788115410 0x7f478811d7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 --2- 10.20.193.90:0/398908591 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f478810f200 0x7f478811d270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:24.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 >> 10.20.193.90:0/398908591 conn(0x7f47880eca60 msgr2=0x7f478810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:24.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 shutdown_connections 2026-02-19T21:06:24.776 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:24.770+0000 7f478e4b36c0 1 -- 10.20.193.90:0/398908591 wait complete. 2026-02-19T21:06:25.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:25 trial105 ceph-mon[33883]: pgmap v235: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:25.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:25 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/398908591' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:25 trial090 ceph-mon[31759]: pgmap v235: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:25.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:25 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/398908591' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:25.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:25 trial175 ceph-mon[34116]: pgmap v235: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:25.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:25 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/398908591' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:27.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:27 trial105 ceph-mon[33883]: pgmap v236: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:27.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:27 trial090 ceph-mon[31759]: pgmap v236: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:27.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:27 trial175 ceph-mon[34116]: pgmap v236: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:06:27.812 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:27.940 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:28.066 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 -- 10.20.193.90:0/1117916896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30114150 msgr2=0x7faf30119100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:28.066 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 --2- 10.20.193.90:0/1117916896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30114150 0x7faf30119100 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=5627945957042535777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf20009970 tx=0x7faf2002ed50 comp rx=0 tx=0).stop 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 -- 10.20.193.90:0/1117916896 shutdown_connections 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 --2- 10.20.193.90:0/1117916896 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7faf301198b0 0x7faf3017a280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 --2- 10.20.193.90:0/1117916896 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30114150 0x7faf30119100 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=5627945957042535777 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 --2- 10.20.193.90:0/1117916896 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7faf30113760 0x7faf30113b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 -- 10.20.193.90:0/1117916896 >> 10.20.193.90:0/1117916896 conn(0x7faf30060720 msgr2=0x7faf30060cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 -- 10.20.193.90:0/1117916896 shutdown_connections 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.062+0000 7faf35e876c0 1 -- 10.20.193.90:0/1117916896 wait complete. 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 Processor -- start 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 -- start start 2026-02-19T21:06:28.067 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7faf30113760 0x7faf30121800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7faf301198b0 0x7faf30121d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 0x7faf301275a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf30127b10 con 0x7faf30127100 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7faf30127c80 con 0x7faf301198b0 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf30127e40 con 0x7faf30113760 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 0x7faf301275a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 0x7faf301275a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43580/0 (socket says 10.20.193.90:43580) 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 -- 10.20.193.90:0/3936977973 learned_addr learned my addr 10.20.193.90:0/3936977973 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2effd6c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7faf301198b0 0x7faf30121d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 -- 10.20.193.90:0/3936977973 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7faf30113760 msgr2=0x7faf30121800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7faf30113760 0x7faf30121800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.068 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 -- 10.20.193.90:0/3936977973 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7faf301198b0 msgr2=0x7faf30121d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7faf301198b0 0x7faf30121d40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 -- 10.20.193.90:0/3936977973 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf20009590 con 0x7faf30127100 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2ffff6c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 0x7faf301275a0 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf24006ea0 tx=0x7faf2400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf24003a30 con 0x7faf30127100 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7faf240054f0 con 0x7faf30127100 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf301682f0 con 0x7faf30127100 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf2400dcd0 con 0x7faf30127100 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.063+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf30168780 con 0x7faf30127100 2026-02-19T21:06:28.069 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.064+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf301149a0 con 0x7faf30127100 2026-02-19T21:06:28.071 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.066+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7faf24005030 con 0x7faf30127100 2026-02-19T21:06:28.071 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.066+0000 7faf2cff96c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7faf040b5650 0x7faf040d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:28.071 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.066+0000 7faf2f7fe6c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7faf040b5650 0x7faf040d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:28.071 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.066+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7faf240e4cc0 con 0x7faf30127100 2026-02-19T21:06:28.071 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.067+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faf240e51b0 con 0x7faf30127100 2026-02-19T21:06:28.071 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.067+0000 7faf2f7fe6c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7faf040b5650 0x7faf040d5b00 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf1c005980 tx=0x7faf1c005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:28.181 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.180+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faf30113b30 con 0x7faf30127100 2026-02-19T21:06:28.182 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.180+0000 7faf2cff96c0 1 -- 10.20.193.90:0/3936977973 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faf240a76b0 con 0x7faf30127100 2026-02-19T21:06:28.182 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:28.182 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:28.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7faf040b5650 msgr2=0x7faf040d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:28.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7faf040b5650 0x7faf040d5b00 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf1c005980 tx=0x7faf1c005910 comp rx=0 tx=0).stop 2026-02-19T21:06:28.183 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 msgr2=0x7faf301275a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 0x7faf301275a0 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf24006ea0 tx=0x7faf2400cca0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 shutdown_connections 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7faf040b5650 0x7faf040d5b00 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7faf30127100 0x7faf301275a0 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7faf301198b0 0x7faf30121d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 --2- 10.20.193.90:0/3936977973 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7faf30113760 0x7faf30121800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 >> 10.20.193.90:0/3936977973 conn(0x7faf30060720 msgr2=0x7faf30115ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 shutdown_connections 2026-02-19T21:06:28.184 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:28.181+0000 7faf35e876c0 1 -- 10.20.193.90:0/3936977973 wait complete. 2026-02-19T21:06:28.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:28 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3936977973' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:28.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:28 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3936977973' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:28.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:28 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3936977973' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:29.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:29 trial105 ceph-mon[33883]: pgmap v237: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:29.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:29 trial090 ceph-mon[31759]: pgmap v237: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:29.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:29 trial175 ceph-mon[34116]: pgmap v237: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:30.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:30 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:06:30.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:30 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:06:30.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:30 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:06:31.221 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:31.345 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:31.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.451+0000 7f9de32246c0 1 -- 10.20.193.90:0/4169027211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10d940 msgr2=0x7f9ddc112980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:31.455 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.451+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4169027211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10d940 0x7f9ddc112980 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=1426277159947915622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dc40099a0 tx=0x7f9dc402ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- 10.20.193.90:0/4169027211 shutdown_connections 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4169027211 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9ddc113160 0x7f9ddc173b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4169027211 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10d940 0x7f9ddc112980 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=1426277159947915622 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4169027211 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc10d320 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- 10.20.193.90:0/4169027211 >> 10.20.193.90:0/4169027211 conn(0x7f9ddc0ea870 msgr2=0x7f9ddc10ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- 10.20.193.90:0/4169027211 shutdown_connections 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- 10.20.193.90:0/4169027211 wait complete. 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 Processor -- start 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- start start 2026-02-19T21:06:31.456 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc0f56a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9ddc113160 0x7f9ddc173a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9ddc0f5cd0 0x7f9ddc0fafa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0f63c0 con 0x7f9ddc10cf50 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0fb4e0 con 0x7f9ddc0f5cd0 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de32246c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ddc0fb6a0 con 0x7f9ddc113160 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc0f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc0f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:43602/0 (socket says 10.20.193.90:43602) 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 -- 10.20.193.90:0/4166659244 learned_addr learned my addr 10.20.193.90:0/4166659244 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de17966c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9ddc0f5cd0 0x7f9ddc0fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 -- 10.20.193.90:0/4166659244 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9ddc113160 msgr2=0x7f9ddc173a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9ddc113160 0x7f9ddc173a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 -- 10.20.193.90:0/4166659244 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9ddc0f5cd0 msgr2=0x7f9ddc0fafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9ddc0f5cd0 0x7f9ddc0fafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 -- 10.20.193.90:0/4166659244 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc4009590 con 0x7f9ddc10cf50 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.452+0000 7f9de0f956c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc0f56a0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dcc00b710 tx=0x7f9dcc00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.453+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9dcc004250 con 0x7f9ddc10cf50 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.453+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9dcc002d80 con 0x7f9ddc10cf50 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.453+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ddc0fb980 con 0x7f9ddc10cf50 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.453+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9dcc00cda0 con 0x7f9ddc10cf50 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.453+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ddc0fc110 con 0x7f9ddc10cf50 2026-02-19T21:06:31.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.453+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ddc10e220 con 0x7f9ddc10cf50 2026-02-19T21:06:31.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.454+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f9dcc0028c0 con 0x7f9ddc10cf50 2026-02-19T21:06:31.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.455+0000 7f9dd1ffb6c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9db80b56d0 0x7f9db80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:31.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.455+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f9dcc0e3c00 con 0x7f9ddc10cf50 2026-02-19T21:06:31.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.455+0000 7f9dd3fff6c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9db80b56d0 0x7f9db80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:31.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.455+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9dcc11c660 con 0x7f9ddc10cf50 2026-02-19T21:06:31.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.456+0000 7f9dd3fff6c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9db80b56d0 0x7f9db80d5b80 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dc40092e0 tx=0x7f9dc4005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:31.554 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: pgmap v238: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:06:31.555 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:06:31.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.569+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ddc10d320 con 0x7f9ddc10cf50 2026-02-19T21:06:31.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.569+0000 7f9dd1ffb6c0 1 -- 10.20.193.90:0/4166659244 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9dcc0a65b0 con 0x7f9ddc10cf50 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: pgmap v238: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:06:31.571 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:06:31.572 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9db80b56d0 msgr2=0x7f9db80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9db80b56d0 0x7f9db80d5b80 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dc40092e0 tx=0x7f9dc4005c60 comp rx=0 tx=0).stop 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 msgr2=0x7f9ddc0f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc0f56a0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dcc00b710 tx=0x7f9dcc00bbe0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 shutdown_connections 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9db80b56d0 0x7f9db80d5b80 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9ddc0f5cd0 0x7f9ddc0fafa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9ddc113160 0x7f9ddc173a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 --2- 10.20.193.90:0/4166659244 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9ddc10cf50 0x7f9ddc0f56a0 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:31.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 >> 10.20.193.90:0/4166659244 conn(0x7f9ddc0ea870 msgr2=0x7f9ddc110790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:31.573 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 shutdown_connections 2026-02-19T21:06:31.573 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:31.570+0000 7f9de32246c0 1 -- 10.20.193.90:0/4166659244 wait complete. 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: pgmap v238: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:06:31.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:06:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:06:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:06:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:06:31.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:06:32.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:32 trial105 ceph-mon[33883]: pgmap v239: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:06:32.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4166659244' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:32 trial090 ceph-mon[31759]: pgmap v239: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:06:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:32 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4166659244' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:32.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:32 trial175 ceph-mon[34116]: pgmap v239: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:06:32.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:32 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4166659244' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:33.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:33 trial105 ceph-mon[33883]: pgmap v240: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:33.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:33 trial090 ceph-mon[31759]: pgmap v240: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:33.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:33 trial175 ceph-mon[34116]: pgmap v240: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:34.611 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:34.740 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/886581408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c10fbf0 msgr2=0x7f9c0c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/886581408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c10fbf0 0x7f9c0c114c30 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=9405679962475151034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bfc0099a0 tx=0x7f9bfc02ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/886581408 shutdown_connections 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/886581408 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9c0c115410 0x7f9c0c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/886581408 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c10fbf0 0x7f9c0c114c30 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=9405679962475151034 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/886581408 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9c0c10f200 0x7f9c0c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/886581408 >> 10.20.193.90:0/886581408 conn(0x7f9c0c0eca60 msgr2=0x7f9c0c10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/886581408 shutdown_connections 2026-02-19T21:06:34.856 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/886581408 wait complete. 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 Processor -- start 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.852+0000 7f9c124dc6c0 1 -- start start 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9c0c10f200 0x7f9c0c0f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9c0c115410 0x7f9c0c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 0x7f9c0c0fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c0f5930 con 0x7f9c0c0f5240 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c0faa50 con 0x7f9c0c115410 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c0fac10 con 0x7f9c0c10f200 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 0x7f9c0c0fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 0x7f9c0c0fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:55386/0 (socket says 10.20.193.90:55386) 2026-02-19T21:06:34.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 -- 10.20.193.90:0/3966478879 learned_addr learned my addr 10.20.193.90:0/3966478879 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c0b7fe6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9c0c115410 0x7f9c0c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c0bfff6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9c0c10f200 0x7f9c0c0f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 -- 10.20.193.90:0/3966478879 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9c0c10f200 msgr2=0x7f9c0c0f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9c0c10f200 0x7f9c0c0f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 -- 10.20.193.90:0/3966478879 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9c0c115410 msgr2=0x7f9c0c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9c0c115410 0x7f9c0c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 -- 10.20.193.90:0/3966478879 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc009590 con 0x7f9c0c0f5240 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c10a526c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 0x7f9c0c0fa510 secure :-1 s=READY pgs=371 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c00006ea0 tx=0x7f9c0000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c00003a30 con 0x7f9c0c0f5240 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9c000054f0 con 0x7f9c0c0f5240 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c0faef0 con 0x7f9c0c0f5240 2026-02-19T21:06:34.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c0000dcd0 con 0x7f9c0c0f5240 2026-02-19T21:06:34.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c0fb680 con 0x7f9c0c0f5240 2026-02-19T21:06:34.859 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.853+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c0c0fb3d0 con 0x7f9c0c0f5240 2026-02-19T21:06:34.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.855+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f9c00003b90 con 0x7f9c0c0f5240 2026-02-19T21:06:34.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.855+0000 7f9c097fa6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9be00b5650 0x7f9be00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:34.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.856+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f9c000e4b50 con 0x7f9c0c0f5240 2026-02-19T21:06:34.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.856+0000 7f9c0bfff6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9be00b5650 0x7f9be00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:34.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.856+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9c000a7540 con 0x7f9c0c0f5240 2026-02-19T21:06:34.860 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.856+0000 7f9c0bfff6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9be00b5650 0x7f9be00d5b00 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf8005dc0 tx=0x7f9bf8005d10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:34.973 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.971+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9c0c0f5d60 con 0x7f9c0c0f5240 2026-02-19T21:06:34.973 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.971+0000 7f9c097fa6c0 1 -- 10.20.193.90:0/3966478879 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9c0000de60 con 0x7f9c0c0f5240 2026-02-19T21:06:34.974 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:34.974 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9be00b5650 msgr2=0x7f9be00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9be00b5650 0x7f9be00d5b00 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf8005dc0 tx=0x7f9bf8005d10 comp rx=0 tx=0).stop 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 msgr2=0x7f9c0c0fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 0x7f9c0c0fa510 secure :-1 s=READY pgs=371 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c00006ea0 tx=0x7f9c0000cca0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 shutdown_connections 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9be00b5650 0x7f9be00d5b00 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.975 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9c0c0f5240 0x7f9c0c0fa510 unknown :-1 s=CLOSED pgs=371 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9c0c115410 0x7f9c0c175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 --2- 10.20.193.90:0/3966478879 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9c0c10f200 0x7f9c0c0f4c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:34.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 >> 10.20.193.90:0/3966478879 conn(0x7f9c0c0eca60 msgr2=0x7f9c0c10d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:34.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 shutdown_connections 2026-02-19T21:06:34.976 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:34.972+0000 7f9c124dc6c0 1 -- 10.20.193.90:0/3966478879 wait complete. 2026-02-19T21:06:35.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:35 trial105 ceph-mon[33883]: pgmap v241: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-19T21:06:35.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:35 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3966478879' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:35.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:35 trial090 ceph-mon[31759]: pgmap v241: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-19T21:06:35.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:35 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3966478879' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:35.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:35 trial175 ceph-mon[34116]: pgmap v241: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 5 op/s 2026-02-19T21:06:35.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:35 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3966478879' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:37.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:37 trial105 ceph-mon[33883]: pgmap v242: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:37.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:37 trial090 ceph-mon[31759]: pgmap v242: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:37 trial175 ceph-mon[34116]: pgmap v242: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:38.013 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:38.141 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/3467327699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10fbf0 msgr2=0x7fe9ac114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/3467327699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10fbf0 0x7fe9ac114c30 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=2234752747997138065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9940099a0 tx=0x7fe99402ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/3467327699 shutdown_connections 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/3467327699 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9ac115410 0x7fe9ac175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/3467327699 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10fbf0 0x7fe9ac114c30 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=2234752747997138065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/3467327699 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9ac10f200 0x7fe9ac10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/3467327699 >> 10.20.193.90:0/3467327699 conn(0x7fe9ac0ecac0 msgr2=0x7fe9ac10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/3467327699 shutdown_connections 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.263+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/3467327699 wait complete. 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 Processor -- start 2026-02-19T21:06:38.266 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 -- start start 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 0x7fe9ac0f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9ac115410 0x7fe9ac175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9ac0f5280 0x7fe9ac0fa500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0f5970 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0faa40 con 0x7fe9ac0f5280 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac0fac00 con 0x7fe9ac115410 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 0x7fe9ac0f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 0x7fe9ac0f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:55408/0 (socket says 10.20.193.90:55408) 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 -- 10.20.193.90:0/1719322031 learned_addr learned my addr 10.20.193.90:0/1719322031 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b12726c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9ac0f5280 0x7fe9ac0fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9a3fff6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9ac115410 0x7fe9ac175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 -- 10.20.193.90:0/1719322031 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9ac115410 msgr2=0x7fe9ac175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9ac115410 0x7fe9ac175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 -- 10.20.193.90:0/1719322031 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9ac0f5280 msgr2=0x7fe9ac0fa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9ac0f5280 0x7fe9ac0fa500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 -- 10.20.193.90:0/1719322031 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe994009590 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b0a716c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 0x7fe9ac0f4c50 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe99c00b710 tx=0x7fe99c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe99c004250 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac0faee0 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe99c002d80 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.264+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe99c00cda0 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.265+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac0fb670 con 0x7fe9ac10f200 2026-02-19T21:06:38.267 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.265+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac1104d0 con 0x7fe9ac10f200 2026-02-19T21:06:38.268 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.267+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fe99c0028c0 con 0x7fe9ac10f200 2026-02-19T21:06:38.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.267+0000 7fe9a1ffb6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe9880b56d0 0x7fe9880d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:38.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.267+0000 7fe9a3fff6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe9880b56d0 0x7fe9880d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:38.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.268+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fe99c0e3ba0 con 0x7fe9ac10f200 2026-02-19T21:06:38.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.268+0000 7fe9a3fff6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe9880b56d0 0x7fe9880d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe994005b40 tx=0x7fe994005c40 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:38.269 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.268+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe99c11c680 con 0x7fe9ac10f200 2026-02-19T21:06:38.384 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.383+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe9ac0f5d50 con 0x7fe9ac10f200 2026-02-19T21:06:38.384 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.383+0000 7fe9a1ffb6c0 1 -- 10.20.193.90:0/1719322031 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe99c0a6590 con 0x7fe9ac10f200 2026-02-19T21:06:38.384 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:38.384 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe9880b56d0 msgr2=0x7fe9880d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe9880b56d0 0x7fe9880d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe994005b40 tx=0x7fe994005c40 comp rx=0 tx=0).stop 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 msgr2=0x7fe9ac0f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 0x7fe9ac0f4c50 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe99c00b710 tx=0x7fe99c00bbe0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 shutdown_connections 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe9880b56d0 0x7fe9880d5b80 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9ac0f5280 0x7fe9ac0fa500 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9ac115410 0x7fe9ac175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 --2- 10.20.193.90:0/1719322031 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9ac10f200 0x7fe9ac0f4c50 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 >> 10.20.193.90:0/1719322031 conn(0x7fe9ac0ecac0 msgr2=0x7fe9ac10d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 shutdown_connections 2026-02-19T21:06:38.386 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:38.384+0000 7fe9b2cfc6c0 1 -- 10.20.193.90:0/1719322031 wait complete. 2026-02-19T21:06:39.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:39 trial105 ceph-mon[33883]: pgmap v243: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:39.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1719322031' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:39.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:39 trial090 ceph-mon[31759]: pgmap v243: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:39.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1719322031' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:39.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:39 trial175 ceph-mon[34116]: pgmap v243: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:39.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1719322031' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:41.429 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:41.553 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:41.574 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:41 trial090 ceph-mon[31759]: pgmap v244: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:41.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:41 trial105 ceph-mon[33883]: pgmap v244: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:41.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/2928713259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 msgr2=0x7fcc1c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:41.679 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/2928713259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c10f5d0 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=16363427476313842013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc100098d0 tx=0x7fcc1002ec40 comp rx=0 tx=0).stop 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/2928713259 shutdown_connections 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/2928713259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc1c115410 0x7fcc1c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/2928713259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc1c10fbf0 0x7fcc1c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/2928713259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c10f5d0 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=16363427476313842013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.676+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/2928713259 >> 10.20.193.90:0/2928713259 conn(0x7fcc1c0eca60 msgr2=0x7fcc1c10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/2928713259 shutdown_connections 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/2928713259 wait complete. 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 Processor -- start 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 -- start start 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c11d250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:41.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc1c115410 0x7fcc1c11d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc1c122b50 0x7fcc1c122ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c123560 con 0x7fcc1c10f200 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c1236d0 con 0x7fcc1c115410 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc219ed6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c123890 con 0x7fcc1c122b50 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c11d250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c11d250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:55438/0 (socket says 10.20.193.90:55438) 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 -- 10.20.193.90:0/3567269939 learned_addr learned my addr 10.20.193.90:0/3567269939 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1b7fe6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc1c122b50 0x7fcc1c122ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1a7fc6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc1c115410 0x7fcc1c11d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 -- 10.20.193.90:0/3567269939 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc1c122b50 msgr2=0x7fcc1c122ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc1c122b50 0x7fcc1c122ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 -- 10.20.193.90:0/3567269939 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc1c115410 msgr2=0x7fcc1c11d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:41.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc1c115410 0x7fcc1c11d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 -- 10.20.193.90:0/3567269939 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc100094c0 con 0x7fcc1c10f200 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc1affd6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c11d250 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc100023c0 tx=0x7fcc1002fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.677+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc10002ae0 con 0x7fcc1c10f200 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.678+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c163ce0 con 0x7fcc1c10f200 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.678+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fcc10005d50 con 0x7fcc1c10f200 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.678+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc100313d0 con 0x7fcc1c10f200 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.678+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c164160 con 0x7fcc1c10f200 2026-02-19T21:06:41.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.678+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1c1104d0 con 0x7fcc1c10f200 2026-02-19T21:06:41.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.679+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fcc10002c40 con 0x7fcc1c10f200 2026-02-19T21:06:41.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.680+0000 7fcc209e76c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf00b56d0 0x7fcbf00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:41.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.680+0000 7fcc1a7fc6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf00b56d0 0x7fcbf00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:41.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.680+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fcc10107e10 con 0x7fcc1c10f200 2026-02-19T21:06:41.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.680+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcc100cd790 con 0x7fcc1c10f200 2026-02-19T21:06:41.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.680+0000 7fcc1a7fc6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf00b56d0 0x7fcbf00d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc04005980 tx=0x7fcc04005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:41.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:41 trial175 ceph-mon[34116]: pgmap v244: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 6 op/s 2026-02-19T21:06:41.794 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.794+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcc1c10f5d0 con 0x7fcc1c10f200 2026-02-19T21:06:41.795 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.794+0000 7fcc209e76c0 1 -- 10.20.193.90:0/3567269939 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcc100cd970 con 0x7fcc1c10f200 2026-02-19T21:06:41.795 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:41.795 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf00b56d0 msgr2=0x7fcbf00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf00b56d0 0x7fcbf00d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc04005980 tx=0x7fcc04005910 comp rx=0 tx=0).stop 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 msgr2=0x7fcc1c11d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c11d250 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc100023c0 tx=0x7fcc1002fb20 comp rx=0 tx=0).stop 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 shutdown_connections 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fcbf00b56d0 0x7fcbf00d5b80 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fcc1c122b50 0x7fcc1c122ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fcc1c115410 0x7fcc1c11d790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 --2- 10.20.193.90:0/3567269939 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fcc1c10f200 0x7fcc1c11d250 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 >> 10.20.193.90:0/3567269939 conn(0x7fcc1c0eca60 msgr2=0x7fcc1c10ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 shutdown_connections 2026-02-19T21:06:41.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:41.795+0000 7fcc219ed6c0 1 -- 10.20.193.90:0/3567269939 wait complete. 2026-02-19T21:06:42.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:42 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3567269939' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:42.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:42 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3567269939' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:42.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:42 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3567269939' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:43.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:43 trial105 ceph-mon[33883]: pgmap v245: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-19T21:06:43.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:43 trial090 ceph-mon[31759]: pgmap v245: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-19T21:06:43.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:43 trial175 ceph-mon[34116]: pgmap v245: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 6 op/s 2026-02-19T21:06:44.836 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:44.962 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:45.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 -- 10.20.193.90:0/2721661403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 msgr2=0x7f8870152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:45.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/2721661403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f8870152d50 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=12780975679404090437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8864009970 tx=0x7f886402ed50 comp rx=0 tx=0).stop 2026-02-19T21:06:45.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 -- 10.20.193.90:0/2721661403 shutdown_connections 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/2721661403 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8870153320 0x7f8870173700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/2721661403 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f8870152d50 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=12780975679404090437 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/2721661403 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f887010dd70 0x7f887010e140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 -- 10.20.193.90:0/2721661403 >> 10.20.193.90:0/2721661403 conn(0x7f88700e96f0 msgr2=0x7f8870109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 -- 10.20.193.90:0/2721661403 shutdown_connections 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.079+0000 7f8877fb06c0 1 -- 10.20.193.90:0/2721661403 wait complete. 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 Processor -- start 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 -- start start 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f887010dd70 0x7f887015f200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f887015f740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:45.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8870153320 0x7f8870164b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8870165150 con 0x7f887010e760 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88701652c0 con 0x7f8870153320 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8870165480 con 0x7f887010dd70 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f887015f740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f887015f740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57168/0 (socket says 10.20.193.90:57168) 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 -- 10.20.193.90:0/835150478 learned_addr learned my addr 10.20.193.90:0/835150478 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 -- 10.20.193.90:0/835150478 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f887010dd70 msgr2=0x7f887015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f887010dd70 0x7f887015f200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 -- 10.20.193.90:0/835150478 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8870153320 msgr2=0x7f8870164b00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8870153320 0x7f8870164b00 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 -- 10.20.193.90:0/835150478 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8864009590 con 0x7f887010e760 2026-02-19T21:06:45.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f88755246c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f887015f740 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8864009290 tx=0x7f886402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:45.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8864002ae0 con 0x7f887010e760 2026-02-19T21:06:45.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8870165700 con 0x7f887010e760 2026-02-19T21:06:45.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8864007680 con 0x7f887010e760 2026-02-19T21:06:45.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.080+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88640375c0 con 0x7f887010e760 2026-02-19T21:06:45.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.081+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887014ee20 con 0x7f887010e760 2026-02-19T21:06:45.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.081+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887005faf0 con 0x7f887010e760 2026-02-19T21:06:45.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.082+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f8864002ca0 con 0x7f887010e760 2026-02-19T21:06:45.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.083+0000 7f885effd6c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f884c0b5650 0x7f884c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:45.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.083+0000 7f8875d256c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f884c0b5650 0x7f884c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:45.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.083+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f8864107f80 con 0x7f887010e760 2026-02-19T21:06:45.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.083+0000 7f8875d256c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f884c0b5650 0x7f884c0d5b00 secure :-1 s=READY pgs=226 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8860005980 tx=0x7f8860005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:45.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.083+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88640ca930 con 0x7f887010e760 2026-02-19T21:06:45.198 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.196+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8870160350 con 0x7f887010e760 2026-02-19T21:06:45.198 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.197+0000 7f885effd6c0 1 -- 10.20.193.90:0/835150478 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8864007d20 con 0x7f887010e760 2026-02-19T21:06:45.199 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:45.199 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.197+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f884c0b5650 msgr2=0x7f884c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.197+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f884c0b5650 0x7f884c0d5b00 secure :-1 s=READY pgs=226 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8860005980 tx=0x7f8860005910 comp rx=0 tx=0).stop 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.197+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 msgr2=0x7f887015f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.197+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f887015f740 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8864009290 tx=0x7f886402fbf0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 shutdown_connections 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f884c0b5650 0x7f884c0d5b00 unknown :-1 s=CLOSED pgs=226 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8870153320 0x7f8870164b00 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.200 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f887010e760 0x7f887015f740 unknown :-1 s=CLOSED pgs=377 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 --2- 10.20.193.90:0/835150478 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f887010dd70 0x7f887015f200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:45.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 >> 10.20.193.90:0/835150478 conn(0x7f88700e96f0 msgr2=0x7f8870109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:45.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 shutdown_connections 2026-02-19T21:06:45.201 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:45.198+0000 7f8877fb06c0 1 -- 10.20.193.90:0/835150478 wait complete. 2026-02-19T21:06:45.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:45 trial105 ceph-mon[33883]: pgmap v246: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:06:45.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/835150478' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:45.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:45 trial090 ceph-mon[31759]: pgmap v246: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:06:45.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/835150478' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:45.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:45 trial175 ceph-mon[34116]: pgmap v246: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:06:45.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/835150478' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:46 trial105 ceph-mon[33883]: pgmap v247: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:06:46.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:46 trial090 ceph-mon[31759]: pgmap v247: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:06:46.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:46 trial175 ceph-mon[34116]: pgmap v247: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:06:48.237 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:48.363 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:48.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.477+0000 7f39099f46c0 1 -- 10.20.193.90:0/1587514828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39040601c0 msgr2=0x7f39041129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:48.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.477+0000 7f39099f46c0 1 --2- 10.20.193.90:0/1587514828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39040601c0 0x7f39041129a0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=16040292883413592416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38ec0099a0 tx=0x7f38ec02ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:48.481 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.477+0000 7f39099f46c0 1 -- 10.20.193.90:0/1587514828 shutdown_connections 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.477+0000 7f39099f46c0 1 --2- 10.20.193.90:0/1587514828 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904113180 0x7f3904173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.477+0000 7f39099f46c0 1 --2- 10.20.193.90:0/1587514828 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f39040601c0 0x7f39041129a0 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=16040292883413592416 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 --2- 10.20.193.90:0/1587514828 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f390405f7d0 0x7f390405fba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- 10.20.193.90:0/1587514828 >> 10.20.193.90:0/1587514828 conn(0x7f39040e96f0 msgr2=0x7f3904109b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- 10.20.193.90:0/1587514828 shutdown_connections 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- 10.20.193.90:0/1587514828 wait complete. 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 Processor -- start 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- start start 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f390405f7d0 0x7f390411b120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 0x7f390411b660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904120a20 0x7f3904120ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:48.482 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3904121430 con 0x7f3904113180 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39041215a0 con 0x7f3904120a20 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3904121760 con 0x7f390405f7d0 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 0x7f390411b660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 0x7f390411b660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57184/0 (socket says 10.20.193.90:57184) 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 -- 10.20.193.90:0/3792999284 learned_addr learned my addr 10.20.193.90:0/3792999284 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f3902ffd6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f390405f7d0 0x7f390411b120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 -- 10.20.193.90:0/3792999284 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f390405f7d0 msgr2=0x7f390411b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f390405f7d0 0x7f390411b120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 -- 10.20.193.90:0/3792999284 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904120a20 msgr2=0x7f3904120ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39037fe6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904120a20 0x7f3904120ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904120a20 0x7f3904120ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.483 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 -- 10.20.193.90:0/3792999284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38ec009590 con 0x7f3904113180 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39037fe6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904120a20 0x7f3904120ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39027fc6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 0x7f390411b660 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38ec004830 tx=0x7f38ec02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38ec002ae0 con 0x7f3904113180 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.478+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3904161bb0 con 0x7f3904113180 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.479+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f38ec007680 con 0x7f3904113180 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.479+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38ec036500 con 0x7f3904113180 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.479+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3904162000 con 0x7f3904113180 2026-02-19T21:06:48.484 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.479+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390410e240 con 0x7f3904113180 2026-02-19T21:06:48.485 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.480+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f38ec007cb0 con 0x7f3904113180 2026-02-19T21:06:48.485 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.481+0000 7f39089f26c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38d80b56d0 0x7f38d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:48.485 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.481+0000 7f3902ffd6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38d80b56d0 0x7f38d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:48.486 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.481+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f38ec107d70 con 0x7f3904113180 2026-02-19T21:06:48.486 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.481+0000 7f3902ffd6c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38d80b56d0 0x7f38d80d5b80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38f8005980 tx=0x7f38f8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:48.486 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.481+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38ec0ca720 con 0x7f3904113180 2026-02-19T21:06:48.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.599+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f390405fba0 con 0x7f3904113180 2026-02-19T21:06:48.601 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.599+0000 7f39089f26c0 1 -- 10.20.193.90:0/3792999284 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38ec0cd8d0 con 0x7f3904113180 2026-02-19T21:06:48.601 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:48.601 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38d80b56d0 msgr2=0x7f38d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38d80b56d0 0x7f38d80d5b80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38f8005980 tx=0x7f38f8005910 comp rx=0 tx=0).stop 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 msgr2=0x7f390411b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 0x7f390411b660 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f38ec004830 tx=0x7f38ec02fbf0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 shutdown_connections 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38d80b56d0 0x7f38d80d5b80 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3904120a20 0x7f3904120ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3904113180 0x7f390411b660 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 --2- 10.20.193.90:0/3792999284 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f390405f7d0 0x7f390411b120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:48.603 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 >> 10.20.193.90:0/3792999284 conn(0x7f39040e96f0 msgr2=0x7f3904109ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:48.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 shutdown_connections 2026-02-19T21:06:48.604 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:48.601+0000 7f39099f46c0 1 -- 10.20.193.90:0/3792999284 wait complete. 2026-02-19T21:06:48.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:48 trial090 ceph-mon[31759]: pgmap v248: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:48.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:48 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3792999284' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:49.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:48 trial175 ceph-mon[34116]: pgmap v248: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:49.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:48 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3792999284' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:49.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:48 trial105 ceph-mon[33883]: pgmap v248: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:49.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:48 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3792999284' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:50.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:50 trial090 ceph-mon[31759]: pgmap v249: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:51.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:50 trial175 ceph-mon[34116]: pgmap v249: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:51.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:50 trial105 ceph-mon[33883]: pgmap v249: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:06:51.642 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:51.769 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2097061209 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 msgr2=0x7f4d18155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2097061209 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18155160 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=194608275635668704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d00009970 tx=0x7f4d0002ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2097061209 shutdown_connections 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2097061209 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d181556a0 0x7f4d18175a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2097061209 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18155160 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=194608275635668704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2097061209 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d180606e0 0x7f4d18060ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2097061209 >> 10.20.193.90:0/2097061209 conn(0x7f4d180ea870 msgr2=0x7f4d1810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2097061209 shutdown_connections 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2097061209 wait complete. 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.882+0000 7f4d1ce006c0 1 Processor -- start 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- start start 2026-02-19T21:06:51.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d180606e0 0x7f4d181615c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18161b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d181556a0 0x7f4d18166ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18167510 con 0x7f4d18060ff0 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18167680 con 0x7f4d181556a0 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d18167840 con 0x7f4d180606e0 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18161b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57206/0 (socket says 10.20.193.90:57206) 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 -- 10.20.193.90:0/2100110738 learned_addr learned my addr 10.20.193.90:0/2100110738 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 -- 10.20.193.90:0/2100110738 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d180606e0 msgr2=0x7f4d181615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d180606e0 0x7f4d181615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:51.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 -- 10.20.193.90:0/2100110738 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d181556a0 msgr2=0x7f4d18166ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d181556a0 0x7f4d18166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 -- 10.20.193.90:0/2100110738 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d00009590 con 0x7f4d18060ff0 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d15d746c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18161b00 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d00031fd0 tx=0x7f4d0002fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d00002ae0 con 0x7f4d18060ff0 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4d00002c40 con 0x7f4d18060ff0 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d18167ac0 con 0x7f4d18060ff0 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d000362f0 con 0x7f4d18060ff0 2026-02-19T21:06:51.887 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181512d0 con 0x7f4d18060ff0 2026-02-19T21:06:51.888 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.883+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d18061bf0 con 0x7f4d18060ff0 2026-02-19T21:06:51.888 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.885+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f4d00007810 con 0x7f4d18060ff0 2026-02-19T21:06:51.888 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.886+0000 7f4cff7fe6c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf00b5650 0x7f4cf00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:51.888 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.886+0000 7f4d165756c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf00b5650 0x7f4cf00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:51.889 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.886+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f4d00107e40 con 0x7f4d18060ff0 2026-02-19T21:06:51.889 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.886+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d000cd7c0 con 0x7f4d18060ff0 2026-02-19T21:06:51.889 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.886+0000 7f4d165756c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf00b5650 0x7f4cf00d5b00 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d0c005980 tx=0x7f4d0c005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:52.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.999+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d18162710 con 0x7f4d18060ff0 2026-02-19T21:06:52.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:51.999+0000 7f4cff7fe6c0 1 -- 10.20.193.90:0/2100110738 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d000cd9a0 con 0x7f4d18060ff0 2026-02-19T21:06:52.001 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:52.002 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:52.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf00b5650 msgr2=0x7f4cf00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf00b5650 0x7f4cf00d5b00 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d0c005980 tx=0x7f4d0c005910 comp rx=0 tx=0).stop 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 msgr2=0x7f4d18161b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18161b00 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d00031fd0 tx=0x7f4d0002fc00 comp rx=0 tx=0).stop 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 shutdown_connections 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4cf00b5650 0x7f4cf00d5b00 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d181556a0 0x7f4d18166ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d18060ff0 0x7f4d18161b00 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 --2- 10.20.193.90:0/2100110738 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d180606e0 0x7f4d181615c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 >> 10.20.193.90:0/2100110738 conn(0x7f4d180ea870 msgr2=0x7f4d1810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:52.003 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 shutdown_connections 2026-02-19T21:06:52.004 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:52.000+0000 7f4d1ce006c0 1 -- 10.20.193.90:0/2100110738 wait complete. 2026-02-19T21:06:53.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:52 trial175 ceph-mon[34116]: pgmap v250: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:53.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:52 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2100110738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:53.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:52 trial105 ceph-mon[33883]: pgmap v250: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:53.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:52 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2100110738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:53.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:52 trial090 ceph-mon[31759]: pgmap v250: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:53.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:52 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2100110738' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:55.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:54 trial175 ceph-mon[34116]: pgmap v251: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:06:55.040 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:55.068 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:54 trial090 ceph-mon[31759]: pgmap v251: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:06:55.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:54 trial105 ceph-mon[33883]: pgmap v251: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:06:55.167 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 -- 10.20.193.90:0/2976071888 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d010fbf0 msgr2=0x7f66d0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/2976071888 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d010fbf0 0x7f66d0114c30 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=6024378139901379675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c00099a0 tx=0x7f66c002ed20 comp rx=0 tx=0).stop 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 -- 10.20.193.90:0/2976071888 shutdown_connections 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/2976071888 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f66d0115410 0x7f66d0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/2976071888 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d010fbf0 0x7f66d0114c30 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=6024378139901379675 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/2976071888 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f66d010f200 0x7f66d010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.275+0000 7f66d60e86c0 1 -- 10.20.193.90:0/2976071888 >> 10.20.193.90:0/2976071888 conn(0x7f66d00ecac0 msgr2=0x7f66d010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- 10.20.193.90:0/2976071888 shutdown_connections 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- 10.20.193.90:0/2976071888 wait complete. 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 Processor -- start 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- start start 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f66d010f200 0x7f66d00f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 0x7f66d0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f66d00f5260 0x7f66d00fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00f5950 con 0x7f66d0115410 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00faa70 con 0x7f66d010f200 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00fac30 con 0x7f66d00f5260 2026-02-19T21:06:55.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 0x7f66d0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 0x7f66d0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50582/0 (socket says 10.20.193.90:50582) 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 -- 10.20.193.90:0/3309282769 learned_addr learned my addr 10.20.193.90:0/3309282769 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66cf7fe6c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f66d010f200 0x7f66d00f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 -- 10.20.193.90:0/3309282769 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f66d00f5260 msgr2=0x7f66d00fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f66d00f5260 0x7f66d00fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 -- 10.20.193.90:0/3309282769 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f66d010f200 msgr2=0x7f66d00f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f66d010f200 0x7f66d00f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 -- 10.20.193.90:0/3309282769 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c0009590 con 0x7f66d0115410 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ceffd6c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 0x7f66d0175cb0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c0004830 tx=0x7f66c002fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66c0002ae0 con 0x7f66d0115410 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f66c0002c40 con 0x7f66d0115410 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d00faeb0 con 0x7f66d0115410 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66c00362f0 con 0x7f66d0115410 2026-02-19T21:06:55.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.276+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d00fb350 con 0x7f66d0115410 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.277+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d01104d0 con 0x7f66d0115410 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.278+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f66c0007810 con 0x7f66d0115410 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.279+0000 7f66ccff96c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66a40b56d0 0x7f66a40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.279+0000 7f66cf7fe6c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66a40b56d0 0x7f66a40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.279+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f66c0107cd0 con 0x7f66d0115410 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.279+0000 7f66cf7fe6c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66a40b56d0 0x7f66a40d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66bc005980 tx=0x7f66bc005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:55.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.279+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f66c00ca680 con 0x7f66d0115410 2026-02-19T21:06:55.396 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.394+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f66d010f5d0 con 0x7f66d0115410 2026-02-19T21:06:55.396 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.394+0000 7f66ccff96c0 1 -- 10.20.193.90:0/3309282769 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f66c00cd830 con 0x7f66d0115410 2026-02-19T21:06:55.396 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:55.396 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66a40b56d0 msgr2=0x7f66a40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66a40b56d0 0x7f66a40d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66bc005980 tx=0x7f66bc005910 comp rx=0 tx=0).stop 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 msgr2=0x7f66d0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 0x7f66d0175cb0 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c0004830 tx=0x7f66c002fbf0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 shutdown_connections 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f66a40b56d0 0x7f66a40d5b80 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f66d00f5260 0x7f66d00fa530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f66d0115410 0x7f66d0175cb0 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 --2- 10.20.193.90:0/3309282769 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f66d010f200 0x7f66d00f4c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 >> 10.20.193.90:0/3309282769 conn(0x7f66d00ecac0 msgr2=0x7f66d010d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 shutdown_connections 2026-02-19T21:06:55.397 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:55.396+0000 7f66d60e86c0 1 -- 10.20.193.90:0/3309282769 wait complete. 2026-02-19T21:06:56.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:55 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3309282769' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:56.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:55 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3309282769' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:56.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:55 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3309282769' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:06:57.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:56 trial175 ceph-mon[34116]: pgmap v252: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:06:57.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:56 trial105 ceph-mon[33883]: pgmap v252: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:06:57.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:56 trial090 ceph-mon[31759]: pgmap v252: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:06:58.436 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:06:58.564 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:06:58.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/700572224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 msgr2=0x7fb954175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:58.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/700572224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb954175db0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=10159402071511153949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb95000aa70 tx=0x7fb95002fde0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.680 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/700572224 shutdown_connections 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/700572224 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb954175db0 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=10159402071511153949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/700572224 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410fbf0 0x7fb954114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/700572224 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb95410f200 0x7fb95410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/700572224 >> 10.20.193.90:0/700572224 conn(0x7fb9540ecac0 msgr2=0x7fb95410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/700572224 shutdown_connections 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/700572224 wait complete. 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 Processor -- start 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- start start 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410f200 0x7fb95411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:58.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb95411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb954122b90 0x7fb954123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb954123570 con 0x7fb954115410 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb9541236e0 con 0x7fb95410f200 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.676+0000 7fb95bdcb6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9541238a0 con 0x7fb954122b90 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb95411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb95411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50604/0 (socket says 10.20.193.90:50604) 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 -- 10.20.193.90:0/3179044101 learned_addr learned my addr 10.20.193.90:0/3179044101 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95a33d6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb954122b90 0x7fb954123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb959b3c6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410f200 0x7fb95411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 -- 10.20.193.90:0/3179044101 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb954122b90 msgr2=0x7fb954123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:58.682 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb954122b90 0x7fb954123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 -- 10.20.193.90:0/3179044101 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410f200 msgr2=0x7fb95411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410f200 0x7fb95411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 -- 10.20.193.90:0/3179044101 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95000a660 con 0x7fb954115410 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb959b3c6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410f200 0x7fb95411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95933b6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb95411d7d0 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb94800b650 tx=0x7fb94800bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9480044a0 con 0x7fb954115410 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb948009030 con 0x7fb954115410 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb94800cc10 con 0x7fb954115410 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb954163d20 con 0x7fb954115410 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9541641b0 con 0x7fb954115410 2026-02-19T21:06:58.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.677+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9541104d0 con 0x7fb954115410 2026-02-19T21:06:58.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.679+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fb9480026b0 con 0x7fb954115410 2026-02-19T21:06:58.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.679+0000 7fb942ffd6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb9300b56d0 0x7fb9300d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:06:58.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.679+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fb9480e3b10 con 0x7fb954115410 2026-02-19T21:06:58.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.680+0000 7fb959b3c6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb9300b56d0 0x7fb9300d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:06:58.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.680+0000 7fb959b3c6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb9300b56d0 0x7fb9300d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb944004750 tx=0x7fb944006e70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:06:58.685 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.680+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb9480a64c0 con 0x7fb954115410 2026-02-19T21:06:58.796 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.794+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb95410f5d0 con 0x7fb954115410 2026-02-19T21:06:58.797 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:58 trial090 ceph-mon[31759]: pgmap v253: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:58.797 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.795+0000 7fb942ffd6c0 1 -- 10.20.193.90:0/3179044101 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb9480a9670 con 0x7fb954115410 2026-02-19T21:06:58.797 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:06:58.798 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb9300b56d0 msgr2=0x7fb9300d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb9300b56d0 0x7fb9300d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb944004750 tx=0x7fb944006e70 comp rx=0 tx=0).stop 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 msgr2=0x7fb95411d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb95411d7d0 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb94800b650 tx=0x7fb94800bb20 comp rx=0 tx=0).stop 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 shutdown_connections 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb9300b56d0 0x7fb9300d5b80 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb954122b90 0x7fb954123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb954115410 0x7fb95411d7d0 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 --2- 10.20.193.90:0/3179044101 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb95410f200 0x7fb95411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:06:58.799 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 >> 10.20.193.90:0/3179044101 conn(0x7fb9540ecac0 msgr2=0x7fb95410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:06:58.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 shutdown_connections 2026-02-19T21:06:58.800 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:06:58.796+0000 7fb95bdcb6c0 1 -- 10.20.193.90:0/3179044101 wait complete. 2026-02-19T21:06:59.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:58 trial175 ceph-mon[34116]: pgmap v253: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:06:59.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:58 trial105 ceph-mon[33883]: pgmap v253: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:00.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:06:59 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3179044101' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:00.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:06:59 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3179044101' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:00.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:06:59 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3179044101' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:01.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:00 trial175 ceph-mon[34116]: pgmap v254: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:00 trial105 ceph-mon[33883]: pgmap v254: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:00 trial090 ceph-mon[31759]: pgmap v254: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:01.837 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:01.965 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:02.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 -- 10.20.193.90:0/2998650364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c10fbf0 msgr2=0x7fef0c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 --2- 10.20.193.90:0/2998650364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c10fbf0 0x7fef0c114c30 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=2822888798028784614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef000099a0 tx=0x7fef0002ed50 comp rx=0 tx=0).stop 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 -- 10.20.193.90:0/2998650364 shutdown_connections 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 --2- 10.20.193.90:0/2998650364 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fef0c115410 0x7fef0c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 --2- 10.20.193.90:0/2998650364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c10fbf0 0x7fef0c114c30 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=2822888798028784614 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 --2- 10.20.193.90:0/2998650364 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c10f200 0x7fef0c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 -- 10.20.193.90:0/2998650364 >> 10.20.193.90:0/2998650364 conn(0x7fef0c0ecac0 msgr2=0x7fef0c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:02.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 -- 10.20.193.90:0/2998650364 shutdown_connections 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 -- 10.20.193.90:0/2998650364 wait complete. 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.084+0000 7fef141f46c0 1 Processor -- start 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- start start 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fef0c10f200 0x7fef0c0f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 0x7fef0c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c0f52c0 0x7fef0c0fa590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c0f5920 con 0x7fef0c115410 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c0faad0 con 0x7fef0c10f200 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef0c0fac90 con 0x7fef0c0f52c0 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 0x7fef0c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:02.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 0x7fef0c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:50616/0 (socket says 10.20.193.90:50616) 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 -- 10.20.193.90:0/3045244296 learned_addr learned my addr 10.20.193.90:0/3045244296 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef11f696c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fef0c10f200 0x7fef0c0f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef1276a6c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c0f52c0 0x7fef0c0fa590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 -- 10.20.193.90:0/3045244296 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c0f52c0 msgr2=0x7fef0c0fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c0f52c0 0x7fef0c0fa590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 -- 10.20.193.90:0/3045244296 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fef0c10f200 msgr2=0x7fef0c0f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fef0c10f200 0x7fef0c0f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 -- 10.20.193.90:0/3045244296 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef00009590 con 0x7fef0c115410 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef1276a6c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c0f52c0 0x7fef0c0fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:02.091 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef117686c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 0x7fef0c175cb0 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef000023a0 tx=0x7fef0002fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef00002ae0 con 0x7fef0c115410 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fef00002c40 con 0x7fef0c115410 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0c0faeb0 con 0x7fef0c115410 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fef000372f0 con 0x7fef0c115410 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0c0fb380 con 0x7fef0c115410 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.085+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0c1104d0 con 0x7fef0c115410 2026-02-19T21:07:02.092 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.087+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fef000071c0 con 0x7fef0c115410 2026-02-19T21:07:02.093 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.087+0000 7feefaffd6c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feee80b56d0 0x7feee80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:02.093 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.087+0000 7fef11f696c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feee80b56d0 0x7feee80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:02.093 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.088+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fef00107e90 con 0x7fef0c115410 2026-02-19T21:07:02.093 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.088+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fef000ce2a0 con 0x7fef0c115410 2026-02-19T21:07:02.093 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.088+0000 7fef11f696c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feee80b56d0 0x7feee80d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feefc005fd0 tx=0x7feefc005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:02.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.201+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fef0c0f5de0 con 0x7fef0c115410 2026-02-19T21:07:02.203 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.201+0000 7feefaffd6c0 1 -- 10.20.193.90:0/3045244296 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fef000d0310 con 0x7fef0c115410 2026-02-19T21:07:02.204 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:02.204 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feee80b56d0 msgr2=0x7feee80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feee80b56d0 0x7feee80d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feefc005fd0 tx=0x7feefc005910 comp rx=0 tx=0).stop 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 msgr2=0x7fef0c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 0x7fef0c175cb0 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef000023a0 tx=0x7fef0002fbe0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 shutdown_connections 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7feee80b56d0 0x7feee80d5b80 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fef0c0f52c0 0x7fef0c0fa590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.205 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fef0c115410 0x7fef0c175cb0 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 --2- 10.20.193.90:0/3045244296 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fef0c10f200 0x7fef0c0f4c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:02.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 >> 10.20.193.90:0/3045244296 conn(0x7fef0c0ecac0 msgr2=0x7fef0c10d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:02.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 shutdown_connections 2026-02-19T21:07:02.206 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:02.202+0000 7fef141f46c0 1 -- 10.20.193.90:0/3045244296 wait complete. 2026-02-19T21:07:03.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:02 trial175 ceph-mon[34116]: pgmap v255: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:03.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:02 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3045244296' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:03.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:02 trial105 ceph-mon[33883]: pgmap v255: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:03.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:02 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3045244296' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:03.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:02 trial090 ceph-mon[31759]: pgmap v255: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:03.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:02 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3045244296' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:05.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:04 trial175 ceph-mon[34116]: pgmap v256: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:05.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:04 trial105 ceph-mon[33883]: pgmap v256: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:05.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:04 trial090 ceph-mon[31759]: pgmap v256: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:05.259 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:05.390 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 -- 10.20.193.90:0/4043321682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc115110 msgr2=0x7f88bc1154e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 --2- 10.20.193.90:0/4043321682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc115110 0x7f88bc1154e0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=1195166075340019691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b00099a0 tx=0x7f88b002ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 -- 10.20.193.90:0/4043321682 shutdown_connections 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 --2- 10.20.193.90:0/4043321682 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88bc118860 0x7f88bc17b3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 --2- 10.20.193.90:0/4043321682 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88bc115b00 0x7f88bc118080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 --2- 10.20.193.90:0/4043321682 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc115110 0x7f88bc1154e0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=1195166075340019691 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 -- 10.20.193.90:0/4043321682 >> 10.20.193.90:0/4043321682 conn(0x7f88bc05c850 msgr2=0x7f88bc058b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 -- 10.20.193.90:0/4043321682 shutdown_connections 2026-02-19T21:07:05.512 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.508+0000 7f88c16806c0 1 -- 10.20.193.90:0/4043321682 wait complete. 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 Processor -- start 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 -- start start 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88bc115110 0x7f88bc0ff8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88bc118860 0x7f88bc17b2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 0x7f88bc1051d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc1005f0 con 0x7f88bc0fff00 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc105710 con 0x7f88bc118860 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc1058d0 con 0x7f88bc115110 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 0x7f88bc1051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 0x7f88bc1051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:40214/0 (socket says 10.20.193.90:40214) 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 -- 10.20.193.90:0/2145245364 learned_addr learned my addr 10.20.193.90:0/2145245364 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88ba7fc6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88bc118860 0x7f88bc17b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88baffd6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88bc115110 0x7f88bc0ff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:05.513 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 -- 10.20.193.90:0/2145245364 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88bc115110 msgr2=0x7f88bc0ff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88bc115110 0x7f88bc0ff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 -- 10.20.193.90:0/2145245364 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88bc118860 msgr2=0x7f88bc17b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88bc118860 0x7f88bc17b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 -- 10.20.193.90:0/2145245364 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b0009590 con 0x7f88bc0fff00 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88bb7fe6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 0x7f88bc1051d0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ac00c6c0 tx=0x7f88ac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88ac003a30 con 0x7f88bc0fff00 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88bc105bb0 con 0x7f88bc0fff00 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f88ac0054e0 con 0x7f88bc0fff00 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88ac00dd10 con 0x7f88bc0fff00 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.509+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88bc106340 con 0x7f88bc0fff00 2026-02-19T21:07:05.514 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.510+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88bc0565d0 con 0x7f88bc0fff00 2026-02-19T21:07:05.515 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.511+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f88ac005080 con 0x7f88bc0fff00 2026-02-19T21:07:05.515 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.512+0000 7f889bfff6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88900b56d0 0x7f88900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:05.515 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.512+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f88ac0e4980 con 0x7f88bc0fff00 2026-02-19T21:07:05.515 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.512+0000 7f88baffd6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88900b56d0 0x7f88900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:05.515 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.512+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88ac0aa340 con 0x7f88bc0fff00 2026-02-19T21:07:05.515 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.512+0000 7f88baffd6c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88900b56d0 0x7f88900d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b0031fd0 tx=0x7f88b00023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:05.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.628+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f88bc100a20 con 0x7f88bc0fff00 2026-02-19T21:07:05.630 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.628+0000 7f889bfff6c0 1 -- 10.20.193.90:0/2145245364 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f88ac0aa520 con 0x7f88bc0fff00 2026-02-19T21:07:05.630 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:05.630 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88900b56d0 msgr2=0x7f88900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88900b56d0 0x7f88900d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88b0031fd0 tx=0x7f88b00023a0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 msgr2=0x7f88bc1051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 0x7f88bc1051d0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ac00c6c0 tx=0x7f88ac00cb90 comp rx=0 tx=0).stop 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 shutdown_connections 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88900b56d0 0x7f88900d5b80 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f88bc0fff00 0x7f88bc1051d0 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f88bc118860 0x7f88bc17b2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 --2- 10.20.193.90:0/2145245364 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f88bc115110 0x7f88bc0ff8d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:05.632 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 >> 10.20.193.90:0/2145245364 conn(0x7f88bc05c850 msgr2=0x7f88bc117250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:05.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 shutdown_connections 2026-02-19T21:07:05.633 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:05.630+0000 7f88c16806c0 1 -- 10.20.193.90:0/2145245364 wait complete. 2026-02-19T21:07:05.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:05 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2145245364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:06.015 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:05 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2145245364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:06.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:05 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2145245364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:07.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:06 trial175 ceph-mon[34116]: pgmap v257: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:07.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:06 trial105 ceph-mon[33883]: pgmap v257: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:07.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:06 trial090 ceph-mon[31759]: pgmap v257: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:08.672 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:08.798 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- 10.20.193.90:0/1011126692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 msgr2=0x7f229810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- 10.20.193.90:0/1011126692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229810f5d0 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=7929157783817812527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22880099a0 tx=0x7f228802ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- 10.20.193.90:0/1011126692 shutdown_connections 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- 10.20.193.90:0/1011126692 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2298115410 0x7f2298175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- 10.20.193.90:0/1011126692 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f229810fbf0 0x7f2298114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- 10.20.193.90:0/1011126692 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229810f5d0 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=7929157783817812527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:08.916 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- 10.20.193.90:0/1011126692 >> 10.20.193.90:0/1011126692 conn(0x7f22980ecac0 msgr2=0x7f229810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- 10.20.193.90:0/1011126692 shutdown_connections 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- 10.20.193.90:0/1011126692 wait complete. 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 Processor -- start 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- start start 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229811d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2298115410 0x7f229811d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2298122bf0 0x7f2298123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2298123600 con 0x7f229810f200 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2298123770 con 0x7f2298122bf0 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.914+0000 7f229eca76c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2298123930 con 0x7f2298115410 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229811d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:40218/0 (socket says 10.20.193.90:40218) 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 -- 10.20.193.90:0/2288764317 learned_addr learned my addr 10.20.193.90:0/2288764317 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229d2196c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2298122bf0 0x7f2298123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f228ffff6c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2298115410 0x7f229811d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 -- 10.20.193.90:0/2288764317 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2298115410 msgr2=0x7f229811d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2298115410 0x7f229811d830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 -- 10.20.193.90:0/2288764317 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2298122bf0 msgr2=0x7f2298123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2298122bf0 0x7f2298123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:08.917 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 -- 10.20.193.90:0/2288764317 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2288009590 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229ca186c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229811d2f0 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f228802f230 tx=0x7f228802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2288002ba0 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2288002d00 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22880372f0 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2298163d80 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2298164200 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.915+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22981104d0 con 0x7f229810f200 2026-02-19T21:07:08.918 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.917+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f22880078d0 con 0x7f229810f200 2026-02-19T21:07:08.919 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.918+0000 7f228dffb6c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22740b56d0 0x7f22740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:08.919 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.918+0000 7f228ffff6c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22740b56d0 0x7f22740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:08.919 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.918+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2288107b50 con 0x7f229810f200 2026-02-19T21:07:08.919 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.918+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2288140620 con 0x7f229810f200 2026-02-19T21:07:08.920 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:08.918+0000 7f228ffff6c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22740b56d0 0x7f22740d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2298123c80 tx=0x7f2280009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:09.015 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:08 trial175 ceph-mon[34116]: pgmap v258: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:09.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.032+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f229810fbf0 con 0x7f229810f200 2026-02-19T21:07:09.034 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:08 trial090 ceph-mon[31759]: pgmap v258: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:09.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.032+0000 7f228dffb6c0 1 -- 10.20.193.90:0/2288764317 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f22880ca540 con 0x7f229810f200 2026-02-19T21:07:09.034 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:09.034 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22740b56d0 msgr2=0x7f22740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22740b56d0 0x7f22740d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2298123c80 tx=0x7f2280009390 comp rx=0 tx=0).stop 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 msgr2=0x7f229811d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229811d2f0 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f228802f230 tx=0x7f228802fd40 comp rx=0 tx=0).stop 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 shutdown_connections 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f22740b56d0 0x7f22740d5b80 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2298122bf0 0x7f2298123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2298115410 0x7f229811d830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 --2- 10.20.193.90:0/2288764317 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f229810f200 0x7f229811d2f0 unknown :-1 s=CLOSED pgs=391 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 >> 10.20.193.90:0/2288764317 conn(0x7f22980ecac0 msgr2=0x7f229810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 shutdown_connections 2026-02-19T21:07:09.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:09.033+0000 7f229eca76c0 1 -- 10.20.193.90:0/2288764317 wait complete. 2026-02-19T21:07:09.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:08 trial105 ceph-mon[33883]: pgmap v258: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:10.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:09 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2288764317' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:10.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:09 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2288764317' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:10.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:09 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2288764317' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:11.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:10 trial175 ceph-mon[34116]: pgmap v259: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:11.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:10 trial105 ceph-mon[33883]: pgmap v259: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:11.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:10 trial090 ceph-mon[31759]: pgmap v259: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:12.072 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:12.198 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- 10.20.193.90:0/1300781272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b7410f200 msgr2=0x7f0b7410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/1300781272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b7410f200 0x7f0b7410f5d0 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=15728746488576013726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b600099a0 tx=0x7f0b6002ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- 10.20.193.90:0/1300781272 shutdown_connections 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/1300781272 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b74115410 0x7f0b74175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/1300781272 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0b7410fbf0 0x7f0b74114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/1300781272 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b7410f200 0x7f0b7410f5d0 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=15728746488576013726 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- 10.20.193.90:0/1300781272 >> 10.20.193.90:0/1300781272 conn(0x7f0b740eca60 msgr2=0x7f0b7410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:12.315 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- 10.20.193.90:0/1300781272 shutdown_connections 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- 10.20.193.90:0/1300781272 wait complete. 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 Processor -- start 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- start start 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b7410f200 0x7f0b7411d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0b74115410 0x7f0b7411d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 0x7f0b74123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74123570 con 0x7f0b74122b60 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b741236e0 con 0x7f0b74115410 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b79f186c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0b741238a0 con 0x7f0b7410f200 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b73fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 0x7f0b74123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:12.316 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b73fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 0x7f0b74123000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:40240/0 (socket says 10.20.193.90:40240) 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.311+0000 7f0b73fff6c0 1 -- 10.20.193.90:0/766219038 learned_addr learned my addr 10.20.193.90:0/766219038 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b72ffd6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0b74115410 0x7f0b7411d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b73fff6c0 1 -- 10.20.193.90:0/766219038 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b7410f200 msgr2=0x7f0b7411d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b737fe6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b7410f200 0x7f0b7411d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b73fff6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b7410f200 0x7f0b7411d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b73fff6c0 1 -- 10.20.193.90:0/766219038 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0b74115410 msgr2=0x7f0b7411d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b73fff6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0b74115410 0x7f0b7411d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b73fff6c0 1 -- 10.20.193.90:0/766219038 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b60009590 con 0x7f0b74122b60 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b737fe6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b7410f200 0x7f0b7411d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b73fff6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 0x7f0b74123000 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b6800c6c0 tx=0x7f0b6800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b68003a30 con 0x7f0b74122b60 2026-02-19T21:07:12.317 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0b680054e0 con 0x7f0b74122b60 2026-02-19T21:07:12.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b74163d50 con 0x7f0b74122b60 2026-02-19T21:07:12.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0b6800dc50 con 0x7f0b74122b60 2026-02-19T21:07:12.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741641e0 con 0x7f0b74122b60 2026-02-19T21:07:12.318 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.312+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b741104d0 con 0x7f0b74122b60 2026-02-19T21:07:12.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.313+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f0b68005080 con 0x7f0b74122b60 2026-02-19T21:07:12.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.314+0000 7f0b70ff96c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0b480b56d0 0x7f0b480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:12.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.314+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f0b680e4ab0 con 0x7f0b74122b60 2026-02-19T21:07:12.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.314+0000 7f0b737fe6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0b480b56d0 0x7f0b480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:12.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.315+0000 7f0b737fe6c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0b480b56d0 0x7f0b480d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b60009970 tx=0x7f0b600023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:12.319 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.315+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0b680a7460 con 0x7f0b74122b60 2026-02-19T21:07:12.434 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.432+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0b7410f5d0 con 0x7f0b74122b60 2026-02-19T21:07:12.434 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.432+0000 7f0b70ff96c0 1 -- 10.20.193.90:0/766219038 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0b680aa610 con 0x7f0b74122b60 2026-02-19T21:07:12.435 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:12.435 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:12.435 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.433+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0b480b56d0 msgr2=0x7f0b480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0b480b56d0 0x7f0b480d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b60009970 tx=0x7f0b600023a0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 msgr2=0x7f0b74123000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 0x7f0b74123000 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0b6800c6c0 tx=0x7f0b6800cb90 comp rx=0 tx=0).stop 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 shutdown_connections 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0b480b56d0 0x7f0b480d5b80 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0b74122b60 0x7f0b74123000 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0b74115410 0x7f0b7411d7a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 --2- 10.20.193.90:0/766219038 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0b7410f200 0x7f0b7411d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 >> 10.20.193.90:0/766219038 conn(0x7f0b740eca60 msgr2=0x7f0b7410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:12.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 shutdown_connections 2026-02-19T21:07:12.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:12.434+0000 7f0b79f186c0 1 -- 10.20.193.90:0/766219038 wait complete. 2026-02-19T21:07:13.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:12 trial175 ceph-mon[34116]: pgmap v260: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:13.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:12 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/766219038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:13.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:12 trial105 ceph-mon[33883]: pgmap v260: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:13.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:12 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/766219038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:12 trial090 ceph-mon[31759]: pgmap v260: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:13.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:12 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/766219038' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:15.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:14 trial175 ceph-mon[34116]: pgmap v261: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:15.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:14 trial105 ceph-mon[33883]: pgmap v261: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:15.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:14 trial090 ceph-mon[31759]: pgmap v261: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:15.473 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:15.598 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:15.719 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.714+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/918310913 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e0113180 msgr2=0x7f37e0173b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.714+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/918310913 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e0113180 0x7f37e0173b20 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=2874852680395890441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc00aa70 tx=0x7f37dc02fde0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.714+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/918310913 shutdown_connections 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.714+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/918310913 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e0113180 0x7f37e0173b20 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=2874852680395890441 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.714+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/918310913 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f37e010d960 0x7f37e01129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.714+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/918310913 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f37e010cf70 0x7f37e010d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/918310913 >> 10.20.193.90:0/918310913 conn(0x7f37e00ea870 msgr2=0x7f37e010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:15.720 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/918310913 shutdown_connections 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/918310913 wait complete. 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 Processor -- start 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- start start 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 0x7f37e011af40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f37e0113180 0x7f37e011b480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f37e0120840 0x7f37e0120ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:15.721 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0121250 con 0x7f37e010cf70 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01213c0 con 0x7f37e0113180 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e6eb06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0121580 con 0x7f37e0120840 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 0x7f37e011af40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 0x7f37e011af40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57528/0 (socket says 10.20.193.90:57528) 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 -- 10.20.193.90:0/1020239874 learned_addr learned my addr 10.20.193.90:0/1020239874 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e54226c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f37e0120840 0x7f37e0120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37d7fff6c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f37e0113180 0x7f37e011b480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 -- 10.20.193.90:0/1020239874 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f37e0120840 msgr2=0x7f37e0120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:15.722 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f37e0120840 0x7f37e0120ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 -- 10.20.193.90:0/1020239874 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f37e0113180 msgr2=0x7f37e011b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f37e0113180 0x7f37e011b480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 -- 10.20.193.90:0/1020239874 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc00a660 con 0x7f37e010cf70 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37e4c216c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 0x7f37e011af40 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d000b710 tx=0x7f37d000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.715+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d0004250 con 0x7f37e010cf70 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.716+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e0161a30 con 0x7f37e010cf70 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.716+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e0161f10 con 0x7f37e010cf70 2026-02-19T21:07:15.723 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.716+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f37d0002d80 con 0x7f37e010cf70 2026-02-19T21:07:15.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.716+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37d000cd90 con 0x7f37e010cf70 2026-02-19T21:07:15.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.716+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e010e240 con 0x7f37e010cf70 2026-02-19T21:07:15.724 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.717+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f37d00043b0 con 0x7f37e010cf70 2026-02-19T21:07:15.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.718+0000 7f37d5ffb6c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f37bc0b56d0 0x7f37bc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:15.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.718+0000 7f37d7fff6c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f37bc0b56d0 0x7f37bc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:15.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.718+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f37d00e3c70 con 0x7f37e010cf70 2026-02-19T21:07:15.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.718+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f37d00e40f0 con 0x7f37e010cf70 2026-02-19T21:07:15.726 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.718+0000 7f37d7fff6c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f37bc0b56d0 0x7f37bc0d5b80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c8005980 tx=0x7f37c8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:15.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.834+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f37e011c090 con 0x7f37e010cf70 2026-02-19T21:07:15.836 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.834+0000 7f37d5ffb6c0 1 -- 10.20.193.90:0/1020239874 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f37d00a6620 con 0x7f37e010cf70 2026-02-19T21:07:15.837 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:15.837 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:15.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f37bc0b56d0 msgr2=0x7f37bc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:15.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f37bc0b56d0 0x7f37bc0d5b80 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37c8005980 tx=0x7f37c8005910 comp rx=0 tx=0).stop 2026-02-19T21:07:15.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 msgr2=0x7f37e011af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:15.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 0x7f37e011af40 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37d000b710 tx=0x7f37d000bbe0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.838 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 shutdown_connections 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f37bc0b56d0 0x7f37bc0d5b80 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f37e0120840 0x7f37e0120ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f37e0113180 0x7f37e011b480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 --2- 10.20.193.90:0/1020239874 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f37e010cf70 0x7f37e011af40 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 >> 10.20.193.90:0/1020239874 conn(0x7f37e00ea870 msgr2=0x7f37e010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 shutdown_connections 2026-02-19T21:07:15.839 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:15.835+0000 7f37e6eb06c0 1 -- 10.20.193.90:0/1020239874 wait complete. 2026-02-19T21:07:17.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:16 trial175 ceph-mon[34116]: pgmap v262: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:17.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:16 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1020239874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:17.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:16 trial105 ceph-mon[33883]: pgmap v262: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:17.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:16 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1020239874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:17.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:16 trial090 ceph-mon[31759]: pgmap v262: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:17.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:16 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1020239874' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:18.875 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:19.001 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:19.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:18 trial175 ceph-mon[34116]: pgmap v263: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:19.021 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:18 trial090 ceph-mon[31759]: pgmap v263: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:19.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/4202362462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 msgr2=0x7f1ad8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:19.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/4202362462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad8175db0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=14090109466351782432 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ac800aa70 tx=0x7f1ac802fde0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/4202362462 shutdown_connections 2026-02-19T21:07:19.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/4202362462 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad8175db0 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=14090109466351782432 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.129 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/4202362462 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1ad810fbf0 0x7f1ad8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/4202362462 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad810f200 0x7f1ad810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/4202362462 >> 10.20.193.90:0/4202362462 conn(0x7f1ad80ecac0 msgr2=0x7f1ad810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/4202362462 shutdown_connections 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/4202362462 wait complete. 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 Processor -- start 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- start start 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1ad810f200 0x7f1ad811d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad811d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad8122af0 0x7f1ad8122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:19.130 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8123500 con 0x7f1ad8115410 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8123670 con 0x7f1ad810f200 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1adcfbc6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8123830 con 0x7f1ad8122af0 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1ad5d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad811d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1ad5d746c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad811d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57544/0 (socket says 10.20.193.90:57544) 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.125+0000 7f1ad5d746c0 1 -- 10.20.193.90:0/3768772160 learned_addr learned my addr 10.20.193.90:0/3768772160 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad65756c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1ad810f200 0x7f1ad811d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad6d766c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad8122af0 0x7f1ad8122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad5d746c0 1 -- 10.20.193.90:0/3768772160 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad8122af0 msgr2=0x7f1ad8122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad5d746c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad8122af0 0x7f1ad8122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.131 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad5d746c0 1 -- 10.20.193.90:0/3768772160 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1ad810f200 msgr2=0x7f1ad811d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad5d746c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1ad810f200 0x7f1ad811d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad5d746c0 1 -- 10.20.193.90:0/3768772160 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac800a660 con 0x7f1ad8115410 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad6d766c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad8122af0 0x7f1ad8122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1ad5d746c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad811d730 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ac000b6c0 tx=0x7f1ac000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ac00044a0 con 0x7f1ad8115410 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1ac0009030 con 0x7f1ad8115410 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1ac000cc10 con 0x7f1ad8115410 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad8163ce0 con 0x7f1ad8115410 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad8164170 con 0x7f1ad8115410 2026-02-19T21:07:19.132 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.126+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad81104d0 con 0x7f1ad8115410 2026-02-19T21:07:19.133 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.127+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f1ac00026b0 con 0x7f1ad8115410 2026-02-19T21:07:19.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.128+0000 7f1abf7fe6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1ab00b56d0 0x7f1ab00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:19.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.128+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f1ac00e3a10 con 0x7f1ad8115410 2026-02-19T21:07:19.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.128+0000 7f1ad65756c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1ab00b56d0 0x7f1ab00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:19.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.128+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1ac00a63c0 con 0x7f1ad8115410 2026-02-19T21:07:19.134 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.128+0000 7f1ad65756c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1ab00b56d0 0x7f1ab00d5b80 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1acc005980 tx=0x7f1acc005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:19.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:18 trial105 ceph-mon[33883]: pgmap v263: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:19.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.242+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1ad810f5d0 con 0x7f1ad8115410 2026-02-19T21:07:19.244 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.242+0000 7f1abf7fe6c0 1 -- 10.20.193.90:0/3768772160 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1ac00a9570 con 0x7f1ad8115410 2026-02-19T21:07:19.244 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:19.245 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:19.245 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1ab00b56d0 msgr2=0x7f1ab00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1ab00b56d0 0x7f1ab00d5b80 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1acc005980 tx=0x7f1acc005910 comp rx=0 tx=0).stop 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 msgr2=0x7f1ad811d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad811d730 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ac000b6c0 tx=0x7f1ac000bb90 comp rx=0 tx=0).stop 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 shutdown_connections 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1ab00b56d0 0x7f1ab00d5b80 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1ad8122af0 0x7f1ad8122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1ad8115410 0x7f1ad811d730 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 --2- 10.20.193.90:0/3768772160 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1ad810f200 0x7f1ad811d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 >> 10.20.193.90:0/3768772160 conn(0x7f1ad80ecac0 msgr2=0x7f1ad810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:19.246 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 shutdown_connections 2026-02-19T21:07:19.247 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:19.243+0000 7f1adcfbc6c0 1 -- 10.20.193.90:0/3768772160 wait complete. 2026-02-19T21:07:20.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:19 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3768772160' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:20.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:19 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3768772160' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:20.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:19 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3768772160' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:21.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:20 trial175 ceph-mon[34116]: pgmap v264: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:21.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:20 trial105 ceph-mon[33883]: pgmap v264: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:21.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:20 trial090 ceph-mon[31759]: pgmap v264: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:22.283 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:22.410 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:22.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/3510626321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec10fbf0 msgr2=0x7f90ec114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:22.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/3510626321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec10fbf0 0x7f90ec114c30 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=9202384448353933151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90dc0099a0 tx=0x7f90dc02ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:22.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/3510626321 shutdown_connections 2026-02-19T21:07:22.524 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/3510626321 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f90ec115410 0x7f90ec175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/3510626321 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec10fbf0 0x7f90ec114c30 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=9202384448353933151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/3510626321 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f90ec10f200 0x7f90ec10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/3510626321 >> 10.20.193.90:0/3510626321 conn(0x7f90ec0ecac0 msgr2=0x7f90ec10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/3510626321 shutdown_connections 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.520+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/3510626321 wait complete. 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 Processor -- start 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 -- start start 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f90ec10f200 0x7f90ec0f4c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f90ec115410 0x7f90ec175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:22.525 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 0x7f90ec0fa530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0f5950 con 0x7f90ec0f5260 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0faa70 con 0x7f90ec115410 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0fac30 con 0x7f90ec10f200 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 0x7f90ec0fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 0x7f90ec0fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:57554/0 (socket says 10.20.193.90:57554) 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 -- 10.20.193.90:0/2879188377 learned_addr learned my addr 10.20.193.90:0/2879188377 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90eb7fe6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f90ec10f200 0x7f90ec0f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 -- 10.20.193.90:0/2879188377 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f90ec10f200 msgr2=0x7f90ec0f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f90ec10f200 0x7f90ec0f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 -- 10.20.193.90:0/2879188377 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f90ec115410 msgr2=0x7f90ec175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:22.526 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f90ec115410 0x7f90ec175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 -- 10.20.193.90:0/2879188377 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90dc009590 con 0x7f90ec0f5260 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90ebfff6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 0x7f90ec0fa530 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e0006ea0 tx=0x7f90e000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90e0003a30 con 0x7f90ec0f5260 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec0faf10 con 0x7f90ec0f5260 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f90e00054f0 con 0x7f90ec0f5260 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90e000dcd0 con 0x7f90ec0f5260 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.521+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec0fb6a0 con 0x7f90ec0f5260 2026-02-19T21:07:22.527 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.522+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ec0fb3f0 con 0x7f90ec0f5260 2026-02-19T21:07:22.528 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.523+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f90e0003b90 con 0x7f90ec0f5260 2026-02-19T21:07:22.529 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.524+0000 7f90e8ff96c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f90c00b56d0 0x7f90c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:22.529 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.524+0000 7f90eb7fe6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f90c00b56d0 0x7f90c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:22.529 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.524+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f90e00e4b00 con 0x7f90ec0f5260 2026-02-19T21:07:22.529 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.524+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90e011d5e0 con 0x7f90ec0f5260 2026-02-19T21:07:22.529 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.524+0000 7f90eb7fe6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f90c00b56d0 0x7f90c00d5b80 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d8004750 tx=0x7f90d8009390 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:22.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.641+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f90ec1104d0 con 0x7f90ec0f5260 2026-02-19T21:07:22.643 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.642+0000 7f90e8ff96c0 1 -- 10.20.193.90:0/2879188377 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f90e00a74f0 con 0x7f90ec0f5260 2026-02-19T21:07:22.644 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:22.644 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f90c00b56d0 msgr2=0x7f90c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f90c00b56d0 0x7f90c00d5b80 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90d8004750 tx=0x7f90d8009390 comp rx=0 tx=0).stop 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 msgr2=0x7f90ec0fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 0x7f90ec0fa530 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e0006ea0 tx=0x7f90e000cca0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 shutdown_connections 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f90c00b56d0 0x7f90c00d5b80 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f90ec0f5260 0x7f90ec0fa530 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f90ec115410 0x7f90ec175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.645 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 --2- 10.20.193.90:0/2879188377 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f90ec10f200 0x7f90ec0f4c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:22.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 >> 10.20.193.90:0/2879188377 conn(0x7f90ec0ecac0 msgr2=0x7f90ec10d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:22.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 shutdown_connections 2026-02-19T21:07:22.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:22.643+0000 7f90f20ec6c0 1 -- 10.20.193.90:0/2879188377 wait complete. 2026-02-19T21:07:22.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:22 trial090 ceph-mon[31759]: pgmap v265: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:22.907 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:22 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2879188377' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:23.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:22 trial175 ceph-mon[34116]: pgmap v265: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:23.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:22 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2879188377' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:23.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:22 trial105 ceph-mon[33883]: pgmap v265: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:23.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:22 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2879188377' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:25.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:24 trial175 ceph-mon[34116]: pgmap v266: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:25.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:24 trial105 ceph-mon[33883]: pgmap v266: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:25.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:24 trial090 ceph-mon[31759]: pgmap v266: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:25.688 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:25.815 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:25.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/95698444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d3810f200 msgr2=0x7f4d3810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:25.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/95698444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d3810f200 0x7f4d3810f5d0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=17510566359742424916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d280099a0 tx=0x7f4d2802ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/95698444 shutdown_connections 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/95698444 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d38115410 0x7f4d38175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/95698444 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d3810fbf0 0x7f4d38114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/95698444 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d3810f200 0x7f4d3810f5d0 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=17510566359742424916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/95698444 >> 10.20.193.90:0/95698444 conn(0x7f4d380eca60 msgr2=0x7f4d3810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/95698444 shutdown_connections 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.936+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/95698444 wait complete. 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 Processor -- start 2026-02-19T21:07:25.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 -- start start 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d3810f200 0x7f4d3811d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d38115410 0x7f4d3811d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 0x7f4d38123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38123690 con 0x7f4d38122c80 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d38123800 con 0x7f4d3810f200 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d381239c0 con 0x7f4d38115410 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 0x7f4d38123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 0x7f4d38123120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:39586/0 (socket says 10.20.193.90:39586) 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 -- 10.20.193.90:0/3986970946 learned_addr learned my addr 10.20.193.90:0/3986970946 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:25.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d0c06c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d3810f200 0x7f4d3811d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3c8bf6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d38115410 0x7f4d3811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 -- 10.20.193.90:0/3986970946 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d38115410 msgr2=0x7f4d3811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d38115410 0x7f4d3811d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 -- 10.20.193.90:0/3986970946 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d3810f200 msgr2=0x7f4d3811d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d3810f200 0x7f4d3811d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 -- 10.20.193.90:0/3986970946 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d28009590 con 0x7f4d38122c80 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3d8c16c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 0x7f4d38123120 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d34006ea0 tx=0x7f4d3400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d34003a30 con 0x7f4d38122c80 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4d340054f0 con 0x7f4d38122c80 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d38163e70 con 0x7f4d38122c80 2026-02-19T21:07:25.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d3400dcd0 con 0x7f4d38122c80 2026-02-19T21:07:25.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.937+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d38164300 con 0x7f4d38122c80 2026-02-19T21:07:25.944 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.938+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d381104d0 con 0x7f4d38122c80 2026-02-19T21:07:25.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.939+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f4d34005030 con 0x7f4d38122c80 2026-02-19T21:07:25.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.940+0000 7f4d267fc6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d140b5650 0x7f4d140d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:25.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.940+0000 7f4d3d0c06c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d140b5650 0x7f4d140d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:25.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.940+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f4d340e4c60 con 0x7f4d38122c80 2026-02-19T21:07:25.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.940+0000 7f4d3d0c06c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d140b5650 0x7f4d140d5b00 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d28005b40 tx=0x7f4d280023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:25.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:25.941+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d340a7650 con 0x7f4d38122c80 2026-02-19T21:07:26.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.056+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4d3811e4d0 con 0x7f4d38122c80 2026-02-19T21:07:26.058 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.056+0000 7f4d267fc6c0 1 -- 10.20.193.90:0/3986970946 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d340aa800 con 0x7f4d38122c80 2026-02-19T21:07:26.059 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:26.059 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:26.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d140b5650 msgr2=0x7f4d140d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:26.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d140b5650 0x7f4d140d5b00 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d28005b40 tx=0x7f4d280023a0 comp rx=0 tx=0).stop 2026-02-19T21:07:26.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 msgr2=0x7f4d38123120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:26.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 0x7f4d38123120 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d34006ea0 tx=0x7f4d3400cca0 comp rx=0 tx=0).stop 2026-02-19T21:07:26.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 shutdown_connections 2026-02-19T21:07:26.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f4d140b5650 0x7f4d140d5b00 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:26.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f4d38122c80 0x7f4d38123120 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:26.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4d38115410 0x7f4d3811d8c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:26.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 --2- 10.20.193.90:0/3986970946 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f4d3810f200 0x7f4d3811d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:26.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 >> 10.20.193.90:0/3986970946 conn(0x7f4d380eca60 msgr2=0x7f4d3810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:26.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 shutdown_connections 2026-02-19T21:07:26.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:26.057+0000 7f4d3f34f6c0 1 -- 10.20.193.90:0/3986970946 wait complete. 2026-02-19T21:07:27.015 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:26 trial175 ceph-mon[34116]: pgmap v267: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:27.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:26 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3986970946' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:27.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:26 trial105 ceph-mon[33883]: pgmap v267: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:27.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:26 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3986970946' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:27.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:26 trial090 ceph-mon[31759]: pgmap v267: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:27.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:26 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3986970946' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:29.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:28 trial175 ceph-mon[34116]: pgmap v268: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:29.097 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:29.123 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:28 trial090 ceph-mon[31759]: pgmap v268: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:29.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:28 trial105 ceph-mon[33883]: pgmap v268: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:29.222 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/1683974059 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b410f200 msgr2=0x7f60b410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/1683974059 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b410f200 0x7f60b410f5d0 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=8028471905823506439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a40099a0 tx=0x7f60a402ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/1683974059 shutdown_connections 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/1683974059 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f60b4115410 0x7f60b4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/1683974059 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f60b410fbf0 0x7f60b4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/1683974059 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b410f200 0x7f60b410f5d0 unknown :-1 s=CLOSED pgs=402 gs=1 cs=0 l=1 c_cookie=8028471905823506439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/1683974059 >> 10.20.193.90:0/1683974059 conn(0x7f60b40ecac0 msgr2=0x7f60b410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:29.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/1683974059 shutdown_connections 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.338+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/1683974059 wait complete. 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 Processor -- start 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 -- start start 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f60b410f200 0x7f60b411d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 0x7f60b411d850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f60b4122c10 0x7f60b41230b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4123620 con 0x7f60b4115410 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4123790 con 0x7f60b4122c10 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4123950 con 0x7f60b410f200 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 0x7f60b411d850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 0x7f60b411d850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:39608/0 (socket says 10.20.193.90:39608) 2026-02-19T21:07:29.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 -- 10.20.193.90:0/2329360620 learned_addr learned my addr 10.20.193.90:0/2329360620 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60ba2d16c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f60b410f200 0x7f60b411d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60baad26c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f60b4122c10 0x7f60b41230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 -- 10.20.193.90:0/2329360620 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f60b410f200 msgr2=0x7f60b411d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f60b410f200 0x7f60b411d310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 -- 10.20.193.90:0/2329360620 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f60b4122c10 msgr2=0x7f60b41230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f60b4122c10 0x7f60b41230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 -- 10.20.193.90:0/2329360620 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a4009590 con 0x7f60b4115410 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60b9ad06c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 0x7f60b411d850 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a800b750 tx=0x7f60a800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60a8004a80 con 0x7f60b4115410 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f60a8009030 con 0x7f60b4115410 2026-02-19T21:07:29.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b4163e00 con 0x7f60b4115410 2026-02-19T21:07:29.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f60a800cd00 con 0x7f60b4115410 2026-02-19T21:07:29.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.339+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b4164290 con 0x7f60b4115410 2026-02-19T21:07:29.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.340+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b41104d0 con 0x7f60b4115410 2026-02-19T21:07:29.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.342+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f60a8005020 con 0x7f60b4115410 2026-02-19T21:07:29.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.342+0000 7f609b7fe6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f60900b5650 0x7f60900d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:29.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.342+0000 7f60ba2d16c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f60900b5650 0x7f60900d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:29.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.342+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f60a80e3bb0 con 0x7f60b4115410 2026-02-19T21:07:29.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.342+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f60a811c680 con 0x7f60b4115410 2026-02-19T21:07:29.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.343+0000 7f60ba2d16c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f60900b5650 0x7f60900d5b00 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a4005b40 tx=0x7f60a40023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:29.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.455+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f60b411e4c0 con 0x7f60b4115410 2026-02-19T21:07:29.457 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.456+0000 7f609b7fe6c0 1 -- 10.20.193.90:0/2329360620 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f60a80a65a0 con 0x7f60b4115410 2026-02-19T21:07:29.457 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:29.457 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.456+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f60900b5650 msgr2=0x7f60900d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.456+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f60900b5650 0x7f60900d5b00 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a4005b40 tx=0x7f60a40023a0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 msgr2=0x7f60b411d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 0x7f60b411d850 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60a800b750 tx=0x7f60a800bc20 comp rx=0 tx=0).stop 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 shutdown_connections 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f60900b5650 0x7f60900d5b00 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f60b4122c10 0x7f60b41230b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f60b4115410 0x7f60b411d850 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 --2- 10.20.193.90:0/2329360620 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f60b410f200 0x7f60b411d310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 >> 10.20.193.90:0/2329360620 conn(0x7f60b40ecac0 msgr2=0x7f60b410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 shutdown_connections 2026-02-19T21:07:29.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:29.457+0000 7f60bc55c6c0 1 -- 10.20.193.90:0/2329360620 wait complete. 2026-02-19T21:07:29.906 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:29 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2329360620' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:30.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:29 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2329360620' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:30.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:29 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2329360620' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:31.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:30 trial175 ceph-mon[34116]: pgmap v269: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:31.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:30 trial105 ceph-mon[33883]: pgmap v269: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:31.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:30 trial090 ceph-mon[31759]: pgmap v269: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:32.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:31 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:07:32.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:31 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:07:32.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:31 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:07:32.497 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:32.622 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:32.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- 10.20.193.90:0/2111053177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8115410 msgr2=0x7fdeb8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:32.737 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/2111053177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8115410 0x7fdeb8175db0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=11291847524909354404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdeb400aa70 tx=0x7fdeb402fde0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- 10.20.193.90:0/2111053177 shutdown_connections 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/2111053177 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8115410 0x7fdeb8175db0 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=11291847524909354404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/2111053177 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb810fbf0 0x7fdeb8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/2111053177 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 0x7fdeb810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- 10.20.193.90:0/2111053177 >> 10.20.193.90:0/2111053177 conn(0x7fdeb80eca60 msgr2=0x7fdeb810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- 10.20.193.90:0/2111053177 shutdown_connections 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- 10.20.193.90:0/2111053177 wait complete. 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 Processor -- start 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- start start 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 0x7fdeb811d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:32.738 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb8115410 0x7fdeb811d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 0x7fdeb8122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb8123530 con 0x7fdeb8122b20 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb81236a0 con 0x7fdeb810f200 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebf2176c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb8123860 con 0x7fdeb8115410 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 0x7fdeb8122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 0x7fdeb8122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:39616/0 (socket says 10.20.193.90:39616) 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 -- 10.20.193.90:0/1745476259 learned_addr learned my addr 10.20.193.90:0/1745476259 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebcf886c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 0x7fdeb811d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdeaffff6c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb8115410 0x7fdeb811d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 -- 10.20.193.90:0/1745476259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb8115410 msgr2=0x7fdeb811d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb8115410 0x7fdeb811d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.739 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 -- 10.20.193.90:0/1745476259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 msgr2=0x7fdeb811d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 0x7fdeb811d220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 -- 10.20.193.90:0/1745476259 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb400a660 con 0x7fdeb8122b20 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdeaffff6c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb8115410 0x7fdeb811d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebcf886c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 0x7fdeb811d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdebd7896c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 0x7fdeb8122fc0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdeb40054b0 tx=0x7fdeb40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdeb4003a30 con 0x7fdeb8122b20 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.734+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdeb4003b90 con 0x7fdeb8122b20 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.735+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb8163cb0 con 0x7fdeb8122b20 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.735+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdeb40372f0 con 0x7fdeb8122b20 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.735+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb81640e0 con 0x7fdeb8122b20 2026-02-19T21:07:32.740 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.735+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb81104d0 con 0x7fdeb8122b20 2026-02-19T21:07:32.741 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.736+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fdeb4008260 con 0x7fdeb8122b20 2026-02-19T21:07:32.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.737+0000 7fdeadffb6c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde940b5650 0x7fde940d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:32.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.737+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdeb4108ff0 con 0x7fdeb8122b20 2026-02-19T21:07:32.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.737+0000 7fdebcf886c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde940b5650 0x7fde940d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:32.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.737+0000 7fdebcf886c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde940b5650 0x7fde940d5b00 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdea8004750 tx=0x7fdea8005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:32.742 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.737+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdeb40cb9e0 con 0x7fdeb8122b20 2026-02-19T21:07:32.853 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.852+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdeb810f5d0 con 0x7fdeb8122b20 2026-02-19T21:07:32.854 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.852+0000 7fdeadffb6c0 1 -- 10.20.193.90:0/1745476259 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdeb4003d00 con 0x7fdeb8122b20 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: pgmap v270: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: pgmap v271: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:07:32.855 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:07:32.856 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:32.856 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde940b5650 msgr2=0x7fde940d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde940b5650 0x7fde940d5b00 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdea8004750 tx=0x7fdea8005f10 comp rx=0 tx=0).stop 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 msgr2=0x7fdeb8122fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 0x7fdeb8122fc0 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdeb40054b0 tx=0x7fdeb40054e0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 shutdown_connections 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fde940b5650 0x7fde940d5b00 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdeb8122b20 0x7fdeb8122fc0 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdeb8115410 0x7fdeb811d760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.857 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 --2- 10.20.193.90:0/1745476259 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdeb810f200 0x7fdeb811d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:32.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 >> 10.20.193.90:0/1745476259 conn(0x7fdeb80eca60 msgr2=0x7fdeb810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:32.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 shutdown_connections 2026-02-19T21:07:32.858 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:32.853+0000 7fdebf2176c0 1 -- 10.20.193.90:0/1745476259 wait complete. 2026-02-19T21:07:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: pgmap v270: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:07:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:07:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:07:33.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: pgmap v271: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:33.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:07:33.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:07:33.017 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:07:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: pgmap v270: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:07:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:07:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:07:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: pgmap v271: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:07:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:07:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:07:34.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:33 trial175 ceph-mon[34116]: pgmap v272: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-19T21:07:34.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:33 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1745476259' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:33 trial105 ceph-mon[33883]: pgmap v272: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-19T21:07:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:33 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1745476259' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:34.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:33 trial090 ceph-mon[31759]: pgmap v272: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-19T21:07:34.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:33 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1745476259' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:35.897 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:36.015 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:35 trial175 ceph-mon[34116]: pgmap v273: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:36.023 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:36.045 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:35 trial090 ceph-mon[31759]: pgmap v273: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:36.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- 10.20.193.90:0/1901644394 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410c360 msgr2=0x7f4454155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:36.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- 10.20.193.90:0/1901644394 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410c360 0x7f4454155240 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=2896257399384875072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f443c009970 tx=0x7f443c02ed50 comp rx=0 tx=0).stop 2026-02-19T21:07:36.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- 10.20.193.90:0/1901644394 shutdown_connections 2026-02-19T21:07:36.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- 10.20.193.90:0/1901644394 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4454155780 0x7f4454175b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- 10.20.193.90:0/1901644394 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410c360 0x7f4454155240 unknown :-1 s=CLOSED pgs=406 gs=1 cs=0 l=1 c_cookie=2896257399384875072 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.144 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- 10.20.193.90:0/1901644394 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410ba50 0x7f445410be20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- 10.20.193.90:0/1901644394 >> 10.20.193.90:0/1901644394 conn(0x7f44540e9710 msgr2=0x7f4454109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- 10.20.193.90:0/1901644394 shutdown_connections 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- 10.20.193.90:0/1901644394 wait complete. 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 Processor -- start 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- start start 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 0x7f4454160600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410c360 0x7f4454160b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4454155780 0x7f4454165f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f44541664c0 con 0x7f445410ba50 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4454166630 con 0x7f445410c360 2026-02-19T21:07:36.145 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f445ad646c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f44541667f0 con 0x7f4454155780 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f4458ad96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 0x7f4454160600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f4458ad96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 0x7f4454160600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54878/0 (socket says 10.20.193.90:54878) 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f4458ad96c0 1 -- 10.20.193.90:0/586570976 learned_addr learned my addr 10.20.193.90:0/586570976 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f444bfff6c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410c360 0x7f4454160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.140+0000 7f44592da6c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4454155780 0x7f4454165f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4458ad96c0 1 -- 10.20.193.90:0/586570976 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4454155780 msgr2=0x7f4454165f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4458ad96c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4454155780 0x7f4454165f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4458ad96c0 1 -- 10.20.193.90:0/586570976 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410c360 msgr2=0x7f4454160b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4458ad96c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410c360 0x7f4454160b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4458ad96c0 1 -- 10.20.193.90:0/586570976 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443c009590 con 0x7f445410ba50 2026-02-19T21:07:36.146 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f444bfff6c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410c360 0x7f4454160b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4458ad96c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 0x7f4454160600 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f444400b6c0 tx=0x7f444400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f44440044a0 con 0x7f445410ba50 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f4444009030 con 0x7f445410ba50 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4454166ad0 con 0x7f445410ba50 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f444400cd20 con 0x7f445410ba50 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44541523c0 con 0x7f445410ba50 2026-02-19T21:07:36.147 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.141+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445405fad0 con 0x7f445410ba50 2026-02-19T21:07:36.148 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:35 trial105 ceph-mon[33883]: pgmap v273: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:36.148 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.143+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f4444005080 con 0x7f445410ba50 2026-02-19T21:07:36.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.144+0000 7f4449ffb6c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44300b5650 0x7f44300d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:36.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.144+0000 7f444bfff6c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44300b5650 0x7f44300d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:36.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.144+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f44440e3ae0 con 0x7f445410ba50 2026-02-19T21:07:36.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.144+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f44440a9640 con 0x7f445410ba50 2026-02-19T21:07:36.149 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.144+0000 7f444bfff6c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44300b5650 0x7f44300d5b00 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f443c005b40 tx=0x7f443c0091c0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:36.261 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.260+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f445410be20 con 0x7f445410ba50 2026-02-19T21:07:36.262 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.260+0000 7f4449ffb6c0 1 -- 10.20.193.90:0/586570976 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f44440a9820 con 0x7f445410ba50 2026-02-19T21:07:36.262 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:36.262 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:36.263 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44300b5650 msgr2=0x7f44300d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:36.263 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44300b5650 0x7f44300d5b00 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f443c005b40 tx=0x7f443c0091c0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.263 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 msgr2=0x7f4454160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:36.263 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 0x7f4454160600 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f444400b6c0 tx=0x7f444400bb90 comp rx=0 tx=0).stop 2026-02-19T21:07:36.263 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 shutdown_connections 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f44300b5650 0x7f44300d5b00 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f4454155780 0x7f4454165f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f445410c360 0x7f4454160b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 --2- 10.20.193.90:0/586570976 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f445410ba50 0x7f4454160600 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 >> 10.20.193.90:0/586570976 conn(0x7f44540e9710 msgr2=0x7f4454109af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 shutdown_connections 2026-02-19T21:07:36.264 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:36.261+0000 7f445ad646c0 1 -- 10.20.193.90:0/586570976 wait complete. 2026-02-19T21:07:37.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:36 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/586570976' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:37.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:36 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/586570976' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:37.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:36 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/586570976' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:38.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:37 trial175 ceph-mon[34116]: pgmap v274: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:38.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:37 trial105 ceph-mon[33883]: pgmap v274: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:38.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:37 trial090 ceph-mon[31759]: pgmap v274: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:39.303 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:39.431 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:39.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/180823537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc10fbf0 msgr2=0x7fdcfc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:39.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/180823537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc10fbf0 0x7fdcfc114c30 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=12133475061008762041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdce40099a0 tx=0x7fdce402ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:39.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/180823537 shutdown_connections 2026-02-19T21:07:39.543 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/180823537 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 0x7fdcfc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/180823537 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc10fbf0 0x7fdcfc114c30 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=12133475061008762041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/180823537 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 0x7fdcfc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/180823537 >> 10.20.193.90:0/180823537 conn(0x7fdcfc0ecac0 msgr2=0x7fdcfc10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/180823537 shutdown_connections 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/180823537 wait complete. 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 Processor -- start 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- start start 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 0x7fdcfc0f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 0x7fdcfc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 0x7fdcfc0fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0f5910 con 0x7fdcfc0f5220 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0faa30 con 0x7fdcfc10f200 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdd0116c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0fabf0 con 0x7fdcfc115410 2026-02-19T21:07:39.544 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdcfb5776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 0x7fdcfc0fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdcfb5776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 0x7fdcfc0fa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54892/0 (socket says 10.20.193.90:54892) 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdcfb5776c0 1 -- 10.20.193.90:0/2388992515 learned_addr learned my addr 10.20.193.90:0/2388992515 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdcfad766c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 0x7fdcfc0f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdcfb5776c0 1 -- 10.20.193.90:0/2388992515 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 msgr2=0x7fdcfc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.540+0000 7fdcfa5756c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 0x7fdcfc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfb5776c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 0x7fdcfc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfb5776c0 1 -- 10.20.193.90:0/2388992515 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 msgr2=0x7fdcfc0f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfb5776c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 0x7fdcfc0f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfb5776c0 1 -- 10.20.193.90:0/2388992515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce4009590 con 0x7fdcfc0f5220 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfad766c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 0x7fdcfc0f4bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfa5756c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 0x7fdcfc175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcfb5776c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 0x7fdcfc0fa4f0 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcec00c6c0 tx=0x7fdcec00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcec003a30 con 0x7fdcfc0f5220 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc0faed0 con 0x7fdcfc0f5220 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdcec0054e0 con 0x7fdcfc0f5220 2026-02-19T21:07:39.545 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcec00dd10 con 0x7fdcfc0f5220 2026-02-19T21:07:39.546 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc0fb660 con 0x7fdcfc0f5220 2026-02-19T21:07:39.546 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.541+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcfc1104d0 con 0x7fdcfc0f5220 2026-02-19T21:07:39.546 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.542+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fdcec005080 con 0x7fdcfc0f5220 2026-02-19T21:07:39.546 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.543+0000 7fdcdbfff6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcd00b5650 0x7fdcd00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:39.546 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.543+0000 7fdcfad766c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcd00b5650 0x7fdcd00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:39.547 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.543+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdcec0e49d0 con 0x7fdcfc0f5220 2026-02-19T21:07:39.547 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.543+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdcec0aa390 con 0x7fdcfc0f5220 2026-02-19T21:07:39.547 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.543+0000 7fdcfad766c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcd00b5650 0x7fdcd00d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf0004750 tx=0x7fdcf0005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:39.662 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.661+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdcfc0f5d40 con 0x7fdcfc0f5220 2026-02-19T21:07:39.662 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.661+0000 7fdcdbfff6c0 1 -- 10.20.193.90:0/2388992515 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdcec0aa570 con 0x7fdcfc0f5220 2026-02-19T21:07:39.663 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:39.663 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:39.663 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcd00b5650 msgr2=0x7fdcd00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:39.663 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcd00b5650 0x7fdcd00d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf0004750 tx=0x7fdcf0005f10 comp rx=0 tx=0).stop 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 msgr2=0x7fdcfc0fa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 0x7fdcfc0fa4f0 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcec00c6c0 tx=0x7fdcec00cb90 comp rx=0 tx=0).stop 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 shutdown_connections 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdcd00b5650 0x7fdcd00d5b00 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdcfc0f5220 0x7fdcfc0fa4f0 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdcfc115410 0x7fdcfc175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 --2- 10.20.193.90:0/2388992515 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdcfc10f200 0x7fdcfc0f4bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 >> 10.20.193.90:0/2388992515 conn(0x7fdcfc0ecac0 msgr2=0x7fdcfc113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 shutdown_connections 2026-02-19T21:07:39.664 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:39.662+0000 7fdd0116c6c0 1 -- 10.20.193.90:0/2388992515 wait complete. 2026-02-19T21:07:40.015 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:39 trial175 ceph-mon[34116]: pgmap v275: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:07:40.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2388992515' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:39 trial105 ceph-mon[33883]: pgmap v275: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:07:40.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2388992515' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:40.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:39 trial090 ceph-mon[31759]: pgmap v275: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s rd, 5 op/s 2026-02-19T21:07:40.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2388992515' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:42.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:41 trial175 ceph-mon[34116]: pgmap v276: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:42.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:41 trial105 ceph-mon[33883]: pgmap v276: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:42.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:41 trial090 ceph-mon[31759]: pgmap v276: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:07:42.701 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:42.825 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:42.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 -- 10.20.193.90:0/1189201138 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f744010f200 msgr2=0x7f744010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:42.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 --2- 10.20.193.90:0/1189201138 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f744010f200 0x7f744010f5d0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=14985362652881434927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74300099a0 tx=0x7f743002ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:42.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 -- 10.20.193.90:0/1189201138 shutdown_connections 2026-02-19T21:07:42.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 --2- 10.20.193.90:0/1189201138 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7440115410 0x7f7440175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 --2- 10.20.193.90:0/1189201138 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f744010fbf0 0x7f7440114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 --2- 10.20.193.90:0/1189201138 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f744010f200 0x7f744010f5d0 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=14985362652881434927 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 -- 10.20.193.90:0/1189201138 >> 10.20.193.90:0/1189201138 conn(0x7f74400ecac0 msgr2=0x7f744010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 -- 10.20.193.90:0/1189201138 shutdown_connections 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 -- 10.20.193.90:0/1189201138 wait complete. 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.940+0000 7f744800c6c0 1 Processor -- start 2026-02-19T21:07:42.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 -- start start 2026-02-19T21:07:42.945 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f744010f200 0x7f744011d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 0x7f744011d910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7440122cd0 0x7f7440123170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74401236e0 con 0x7f7440115410 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7440123850 con 0x7f7440122cd0 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7440123a10 con 0x7f744010f200 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 0x7f744011d910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 0x7f744011d910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54910/0 (socket says 10.20.193.90:54910) 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 -- 10.20.193.90:0/3987388496 learned_addr learned my addr 10.20.193.90:0/3987388496 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f7445d816c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f744010f200 0x7f744011d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 -- 10.20.193.90:0/3987388496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f744010f200 msgr2=0x7f744011d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:42.946 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f744010f200 0x7f744011d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 -- 10.20.193.90:0/3987388496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7440122cd0 msgr2=0x7f7440123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7440122cd0 0x7f7440123170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 -- 10.20.193.90:0/3987388496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7430009590 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f74455806c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 0x7f744011d910 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743400b6c0 tx=0x7f743400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74340044a0 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f743400be50 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f743400cc90 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7440163ec0 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.941+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7440164350 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.942+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74401104d0 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.943+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f74340026b0 con 0x7f7440115410 2026-02-19T21:07:42.947 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.944+0000 7f742effd6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f741c0b56d0 0x7f741c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:42.948 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.944+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f74340e39a0 con 0x7f7440115410 2026-02-19T21:07:42.948 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.944+0000 7f7445d816c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f741c0b56d0 0x7f741c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:42.948 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.944+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74340a6350 con 0x7f7440115410 2026-02-19T21:07:42.948 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:42.944+0000 7f7445d816c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f741c0b56d0 0x7f741c0d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74300023e0 tx=0x7f743002f660 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:43.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.060+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f744010f5d0 con 0x7f7440115410 2026-02-19T21:07:43.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.060+0000 7f742effd6c0 1 -- 10.20.193.90:0/3987388496 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74340a9500 con 0x7f7440115410 2026-02-19T21:07:43.062 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:43.062 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f741c0b56d0 msgr2=0x7f741c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f741c0b56d0 0x7f741c0d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74300023e0 tx=0x7f743002f660 comp rx=0 tx=0).stop 2026-02-19T21:07:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 msgr2=0x7f744011d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 0x7f744011d910 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f743400b6c0 tx=0x7f743400bb90 comp rx=0 tx=0).stop 2026-02-19T21:07:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 shutdown_connections 2026-02-19T21:07:43.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f741c0b56d0 0x7f741c0d5b80 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7440122cd0 0x7f7440123170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7440115410 0x7f744011d910 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 --2- 10.20.193.90:0/3987388496 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f744010f200 0x7f744011d3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 >> 10.20.193.90:0/3987388496 conn(0x7f74400ecac0 msgr2=0x7f744010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 shutdown_connections 2026-02-19T21:07:43.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:43.061+0000 7f744800c6c0 1 -- 10.20.193.90:0/3987388496 wait complete. 2026-02-19T21:07:44.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:43 trial175 ceph-mon[34116]: pgmap v277: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:44.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3987388496' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:44.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:43 trial105 ceph-mon[33883]: pgmap v277: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:44.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3987388496' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:44.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:43 trial090 ceph-mon[31759]: pgmap v277: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:44.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3987388496' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:46.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:45 trial175 ceph-mon[34116]: pgmap v278: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:46.102 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:46.127 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:45 trial090 ceph-mon[31759]: pgmap v278: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:46.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:45 trial105 ceph-mon[33883]: pgmap v278: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:46.225 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:46.343 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- 10.20.193.90:0/3628918539 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 msgr2=0x7f2c7c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/3628918539 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c175db0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=4885259060407521751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c6c00aa70 tx=0x7f2c6c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- 10.20.193.90:0/3628918539 shutdown_connections 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/3628918539 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c175db0 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=4885259060407521751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/3628918539 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c7c10fbf0 0x7f2c7c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/3628918539 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c7c10f200 0x7f2c7c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- 10.20.193.90:0/3628918539 >> 10.20.193.90:0/3628918539 conn(0x7f2c7c0ecac0 msgr2=0x7f2c7c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- 10.20.193.90:0/3628918539 shutdown_connections 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- 10.20.193.90:0/3628918539 wait complete. 2026-02-19T21:07:46.344 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 Processor -- start 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- start start 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c7c10f200 0x7f2c7c11d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c11d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c7c122b90 0x7f2c7c123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.341+0000 7f2c812a56c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1235a0 con 0x7f2c7c115410 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c812a56c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c123710 con 0x7f2c7c122b90 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c812a56c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1238d0 con 0x7f2c7c10f200 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c11d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c11d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48438/0 (socket says 10.20.193.90:48438) 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 -- 10.20.193.90:0/1842976844 learned_addr learned my addr 10.20.193.90:0/1842976844 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 -- 10.20.193.90:0/1842976844 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c7c10f200 msgr2=0x7f2c7c11d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:46.345 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c7c10f200 0x7f2c7c11d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 -- 10.20.193.90:0/1842976844 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c7c122b90 msgr2=0x7f2c7c123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c7c122b90 0x7f2c7c123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 -- 10.20.193.90:0/1842976844 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c00a660 con 0x7f2c7c115410 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c7a7fc6c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c11d7d0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c6400b6c0 tx=0x7f2c6400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c640044a0 con 0x7f2c7c115410 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2c64009030 con 0x7f2c7c115410 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c6400cc10 con 0x7f2c7c115410 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7c163d80 con 0x7f2c7c115410 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c7c164210 con 0x7f2c7c115410 2026-02-19T21:07:46.346 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.342+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7c1104d0 con 0x7f2c7c115410 2026-02-19T21:07:46.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.344+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f2c640026b0 con 0x7f2c7c115410 2026-02-19T21:07:46.347 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.344+0000 7f2c5bfff6c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c500b56d0 0x7f2c500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:46.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.344+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2c640e3980 con 0x7f2c7c115410 2026-02-19T21:07:46.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.344+0000 7f2c7affd6c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c500b56d0 0x7f2c500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:46.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.344+0000 7f2c7affd6c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c500b56d0 0x7f2c500d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c70004750 tx=0x7f2c70005cb0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:46.348 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.345+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c640a6330 con 0x7f2c7c115410 2026-02-19T21:07:46.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.459+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c7c10f5d0 con 0x7f2c7c115410 2026-02-19T21:07:46.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.459+0000 7f2c5bfff6c0 1 -- 10.20.193.90:0/1842976844 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2c640a94e0 con 0x7f2c7c115410 2026-02-19T21:07:46.461 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:46.461 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c500b56d0 msgr2=0x7f2c500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c500b56d0 0x7f2c500d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c70004750 tx=0x7f2c70005cb0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 msgr2=0x7f2c7c11d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c11d7d0 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c6400b6c0 tx=0x7f2c6400bb90 comp rx=0 tx=0).stop 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 shutdown_connections 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2c500b56d0 0x7f2c500d5b80 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2c7c122b90 0x7f2c7c123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2c7c115410 0x7f2c7c11d7d0 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 --2- 10.20.193.90:0/1842976844 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2c7c10f200 0x7f2c7c11d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:46.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 >> 10.20.193.90:0/1842976844 conn(0x7f2c7c0ecac0 msgr2=0x7f2c7c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:46.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 shutdown_connections 2026-02-19T21:07:46.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:46.461+0000 7f2c812a56c0 1 -- 10.20.193.90:0/1842976844 wait complete. 2026-02-19T21:07:47.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:46 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1842976844' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:47.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:46 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1842976844' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:47.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:46 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1842976844' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:48.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:47 trial175 ceph-mon[34116]: pgmap v279: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:07:48.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:47 trial105 ceph-mon[33883]: pgmap v279: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:07:48.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:47 trial090 ceph-mon[31759]: pgmap v279: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:07:49.503 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:49.631 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:49.748 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 -- 10.20.193.90:0/3861840727 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047411bb60 msgr2=0x7f047417c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 --2- 10.20.193.90:0/3861840727 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047411bb60 0x7f047417c500 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=1008807671805124022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f046400aa70 tx=0x7f046402fde0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 -- 10.20.193.90:0/3861840727 shutdown_connections 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 --2- 10.20.193.90:0/3861840727 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f047411bb60 0x7f047417c500 unknown :-1 s=CLOSED pgs=414 gs=1 cs=0 l=1 c_cookie=1008807671805124022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 --2- 10.20.193.90:0/3861840727 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0474116340 0x7f047411b380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 --2- 10.20.193.90:0/3861840727 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0474115950 0x7f0474115d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 -- 10.20.193.90:0/3861840727 >> 10.20.193.90:0/3861840727 conn(0x7f047405e020 msgr2=0x7f047405e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 -- 10.20.193.90:0/3861840727 shutdown_connections 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 -- 10.20.193.90:0/3861840727 wait complete. 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 Processor -- start 2026-02-19T21:07:49.749 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.746+0000 7f04794776c0 1 -- start start 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0474115950 0x7f0474123920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f047411bb60 0x7f0474123e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 0x7f04741296c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0474129c00 con 0x7f0474129220 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0474129d70 con 0x7f047411bb60 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0474129f30 con 0x7f0474115950 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 0x7f04741296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 0x7f04741296c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48454/0 (socket says 10.20.193.90:48454) 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 -- 10.20.193.90:0/3797427700 learned_addr learned my addr 10.20.193.90:0/3797427700 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f0472ffd6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0474115950 0x7f0474123920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04727fc6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f047411bb60 0x7f0474123e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:49.750 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 -- 10.20.193.90:0/3797427700 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0474115950 msgr2=0x7f0474123920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0474115950 0x7f0474123920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 -- 10.20.193.90:0/3797427700 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f047411bb60 msgr2=0x7f0474123e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f047411bb60 0x7f0474123e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 -- 10.20.193.90:0/3797427700 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046400a660 con 0x7f0474129220 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04737fe6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 0x7f04741296c0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04640054b0 tx=0x7f04640054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0464003a30 con 0x7f0474129220 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0464003b90 con 0x7f0474129220 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047416a3b0 con 0x7f0474129220 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04640382f0 con 0x7f0474129220 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047416a830 con 0x7f0474129220 2026-02-19T21:07:49.751 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.747+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0474116c20 con 0x7f0474129220 2026-02-19T21:07:49.752 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.749+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f0464008260 con 0x7f0474129220 2026-02-19T21:07:49.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.750+0000 7f0453fff6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04480b56d0 0x7f04480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:49.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.750+0000 7f0472ffd6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04480b56d0 0x7f04480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:49.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.750+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f0464108ef0 con 0x7f0474129220 2026-02-19T21:07:49.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.750+0000 7f0472ffd6c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04480b56d0 0x7f04480d5b80 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0468005980 tx=0x7f0468005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:49.753 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.750+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f04640cb8a0 con 0x7f0474129220 2026-02-19T21:07:49.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.866+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0474115d20 con 0x7f0474129220 2026-02-19T21:07:49.867 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:49 trial090 ceph-mon[31759]: pgmap v280: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:49.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.866+0000 7f0453fff6c0 1 -- 10.20.193.90:0/3797427700 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f04640cea50 con 0x7f0474129220 2026-02-19T21:07:49.868 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:49.868 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04480b56d0 msgr2=0x7f04480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04480b56d0 0x7f04480d5b80 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0468005980 tx=0x7f0468005910 comp rx=0 tx=0).stop 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 msgr2=0x7f04741296c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 0x7f04741296c0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04640054b0 tx=0x7f04640054e0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 shutdown_connections 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04480b56d0 0x7f04480d5b80 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0474129220 0x7f04741296c0 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f047411bb60 0x7f0474123e60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 --2- 10.20.193.90:0/3797427700 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0474115950 0x7f0474123920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:49.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 >> 10.20.193.90:0/3797427700 conn(0x7f047405e020 msgr2=0x7f0474117110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:49.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 shutdown_connections 2026-02-19T21:07:49.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:49.867+0000 7f04794776c0 1 -- 10.20.193.90:0/3797427700 wait complete. 2026-02-19T21:07:50.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:49 trial175 ceph-mon[34116]: pgmap v280: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:50.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:49 trial105 ceph-mon[33883]: pgmap v280: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:07:51.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:50 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3797427700' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:51.046 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:50 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3797427700' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:51.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:50 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3797427700' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:52.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:51 trial175 ceph-mon[34116]: pgmap v281: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:52.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:51 trial105 ceph-mon[33883]: pgmap v281: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:52.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:51 trial090 ceph-mon[31759]: pgmap v281: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:07:52.907 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:53.037 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:53.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- 10.20.193.90:0/654508580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2694115410 msgr2=0x7f2694175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- 10.20.193.90:0/654508580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2694115410 0x7f2694175db0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=1300274007538229725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f268800aa70 tx=0x7f268802fde0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- 10.20.193.90:0/654508580 shutdown_connections 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- 10.20.193.90:0/654508580 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2694115410 0x7f2694175db0 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=1300274007538229725 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- 10.20.193.90:0/654508580 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410fbf0 0x7f2694114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- 10.20.193.90:0/654508580 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f269410f200 0x7f269410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- 10.20.193.90:0/654508580 >> 10.20.193.90:0/654508580 conn(0x7f26940eca60 msgr2=0x7f269410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- 10.20.193.90:0/654508580 shutdown_connections 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- 10.20.193.90:0/654508580 wait complete. 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 Processor -- start 2026-02-19T21:07:53.156 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- start start 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410f200 0x7f26940f4b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2694115410 0x7f2694175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 0x7f26940fa400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26940f5820 con 0x7f26940f5130 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26940fa940 con 0x7f2694115410 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2699e476c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26940fab00 con 0x7f269410f200 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2693fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 0x7f26940fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2693fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 0x7f26940fa400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:48464/0 (socket says 10.20.193.90:48464) 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2693fff6c0 1 -- 10.20.193.90:0/3586009461 learned_addr learned my addr 10.20.193.90:0/3586009461 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2692ffd6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2694115410 0x7f2694175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f26937fe6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410f200 0x7f26940f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:53.157 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2693fff6c0 1 -- 10.20.193.90:0/3586009461 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410f200 msgr2=0x7f26940f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.152+0000 7f2693fff6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410f200 0x7f26940f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2693fff6c0 1 -- 10.20.193.90:0/3586009461 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2694115410 msgr2=0x7f2694175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2693fff6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2694115410 0x7f2694175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2693fff6c0 1 -- 10.20.193.90:0/3586009461 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f268800a660 con 0x7f26940f5130 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f26937fe6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410f200 0x7f26940f4b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2692ffd6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2694115410 0x7f2694175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2693fff6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 0x7f26940fa400 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26880027a0 tx=0x7f26880055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2688003c40 con 0x7f26940f5130 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2688003da0 con 0x7f26940f5130 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2688037380 con 0x7f26940f5130 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26940fad80 con 0x7f26940f5130 2026-02-19T21:07:53.158 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26940fb230 con 0x7f26940f5130 2026-02-19T21:07:53.159 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.153+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26941104d0 con 0x7f26940f5130 2026-02-19T21:07:53.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.154+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f2688008260 con 0x7f26940f5130 2026-02-19T21:07:53.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.155+0000 7f2690ff96c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26680b56d0 0x7f26680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:53.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.155+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2688108fa0 con 0x7f26940f5130 2026-02-19T21:07:53.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.155+0000 7f26937fe6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26680b56d0 0x7f26680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:53.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.155+0000 7f26937fe6c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26680b56d0 0x7f26680d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2680004750 tx=0x7f2680006e70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:53.160 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.156+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26880cb950 con 0x7f26940f5130 2026-02-19T21:07:53.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.273+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f269410f5d0 con 0x7f26940f5130 2026-02-19T21:07:53.275 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.273+0000 7f2690ff96c0 1 -- 10.20.193.90:0/3586009461 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f26880ceb00 con 0x7f26940f5130 2026-02-19T21:07:53.275 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:53.276 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:53.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26680b56d0 msgr2=0x7f26680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:53.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26680b56d0 0x7f26680d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2680004750 tx=0x7f2680006e70 comp rx=0 tx=0).stop 2026-02-19T21:07:53.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 msgr2=0x7f26940fa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:53.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 0x7f26940fa400 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26880027a0 tx=0x7f26880055f0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.277 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 shutdown_connections 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26680b56d0 0x7f26680d5b80 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26940f5130 0x7f26940fa400 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2694115410 0x7f2694175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 --2- 10.20.193.90:0/3586009461 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f269410f200 0x7f26940f4b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 >> 10.20.193.90:0/3586009461 conn(0x7f26940eca60 msgr2=0x7f269410d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 shutdown_connections 2026-02-19T21:07:53.278 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:53.275+0000 7f2699e476c0 1 -- 10.20.193.90:0/3586009461 wait complete. 2026-02-19T21:07:54.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:53 trial175 ceph-mon[34116]: pgmap v282: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:54.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:53 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3586009461' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:54.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:53 trial105 ceph-mon[33883]: pgmap v282: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:54.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:53 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3586009461' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:54.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:53 trial090 ceph-mon[31759]: pgmap v282: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:07:54.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:53 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3586009461' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:56.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:55 trial175 ceph-mon[34116]: pgmap v283: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:56.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:55 trial105 ceph-mon[33883]: pgmap v283: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:56.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:55 trial090 ceph-mon[31759]: pgmap v283: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:07:56.317 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:56.443 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/2226573577 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb9410fbf0 msgr2=0x7fdb94114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/2226573577 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb9410fbf0 0x7fdb94114c30 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=12361408667438706605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c0099a0 tx=0x7fdb7c02ed00 comp rx=0 tx=0).stop 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/2226573577 shutdown_connections 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/2226573577 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdb94115410 0x7fdb94175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/2226573577 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb9410fbf0 0x7fdb94114c30 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=12361408667438706605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/2226573577 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdb9410f200 0x7fdb9410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/2226573577 >> 10.20.193.90:0/2226573577 conn(0x7fdb940ecac0 msgr2=0x7fdb9410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.564+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/2226573577 shutdown_connections 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/2226573577 wait complete. 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 Processor -- start 2026-02-19T21:07:56.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- start start 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdb9410f200 0x7fdb940f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 0x7fdb94175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdb940f5280 0x7fdb940fa500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb940f58e0 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb940faa40 con 0x7fdb940f5280 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb940fac00 con 0x7fdb9410f200 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 0x7fdb94175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 0x7fdb94175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:47898/0 (socket says 10.20.193.90:47898) 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 -- 10.20.193.90:0/1135636556 learned_addr learned my addr 10.20.193.90:0/1135636556 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb988986c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdb9410f200 0x7fdb940f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb990996c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdb940f5280 0x7fdb940fa500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 -- 10.20.193.90:0/1135636556 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdb9410f200 msgr2=0x7fdb940f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdb9410f200 0x7fdb940f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 -- 10.20.193.90:0/1135636556 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdb940f5280 msgr2=0x7fdb940fa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdb940f5280 0x7fdb940fa500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 -- 10.20.193.90:0/1135636556 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c009590 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb8bfff6c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 0x7fdb94175cb0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c031f90 tx=0x7fdb7c02fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb7c002ae0 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb940fae20 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdb7c002c40 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb7c0312b0 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.565+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb940fb2a0 con 0x7fdb94115410 2026-02-19T21:07:56.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.566+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb941104d0 con 0x7fdb94115410 2026-02-19T21:07:56.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.567+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fdb7c007830 con 0x7fdb94115410 2026-02-19T21:07:56.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.568+0000 7fdb89ffb6c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdb700b5650 0x7fdb700d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:56.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.568+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdb7c107e60 con 0x7fdb94115410 2026-02-19T21:07:56.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.568+0000 7fdb988986c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdb700b5650 0x7fdb700d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:56.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.568+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb7c0ca810 con 0x7fdb94115410 2026-02-19T21:07:56.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.568+0000 7fdb988986c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdb700b5650 0x7fdb700d5b00 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb84005fd0 tx=0x7fdb84005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:56.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.685+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdb9410f5d0 con 0x7fdb94115410 2026-02-19T21:07:56.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.685+0000 7fdb89ffb6c0 1 -- 10.20.193.90:0/1135636556 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdb7c002db0 con 0x7fdb94115410 2026-02-19T21:07:56.687 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:07:56.688 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.686+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdb700b5650 msgr2=0x7fdb700d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.686+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdb700b5650 0x7fdb700d5b00 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb84005fd0 tx=0x7fdb84005910 comp rx=0 tx=0).stop 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.686+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 msgr2=0x7fdb94175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.686+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 0x7fdb94175cb0 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c031f90 tx=0x7fdb7c02fbd0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 shutdown_connections 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdb700b5650 0x7fdb700d5b00 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdb940f5280 0x7fdb940fa500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdb94115410 0x7fdb94175cb0 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 --2- 10.20.193.90:0/1135636556 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdb9410f200 0x7fdb940f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:56.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 >> 10.20.193.90:0/1135636556 conn(0x7fdb940ecac0 msgr2=0x7fdb9410d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:56.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 shutdown_connections 2026-02-19T21:07:56.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:56.687+0000 7fdb9ab276c0 1 -- 10.20.193.90:0/1135636556 wait complete. 2026-02-19T21:07:57.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:56 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1135636556' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:57.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:56 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1135636556' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:57.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:56 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1135636556' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:07:58.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:57 trial175 ceph-mon[34116]: pgmap v284: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:07:58.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:57 trial105 ceph-mon[33883]: pgmap v284: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:07:58.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:57 trial090 ceph-mon[31759]: pgmap v284: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:07:59.727 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:07:59.853 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:07:59.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 -- 10.20.193.90:0/3141956061 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c010d960 msgr2=0x7fe9c01129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/3141956061 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c010d960 0x7fe9c01129a0 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=17232735533038956694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b40099a0 tx=0x7fe9b402ed20 comp rx=0 tx=0).stop 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 -- 10.20.193.90:0/3141956061 shutdown_connections 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/3141956061 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9c0113180 0x7fe9c0173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/3141956061 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c010d960 0x7fe9c01129a0 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=17232735533038956694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/3141956061 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9c010cf70 0x7fe9c010d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 -- 10.20.193.90:0/3141956061 >> 10.20.193.90:0/3141956061 conn(0x7fe9c00ea870 msgr2=0x7fe9c010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 -- 10.20.193.90:0/3141956061 shutdown_connections 2026-02-19T21:07:59.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 -- 10.20.193.90:0/3141956061 wait complete. 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 Processor -- start 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.963+0000 7fe9c78046c0 1 -- start start 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9c010cf70 0x7fe9c00f4c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 0x7fe9c0173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9c00f5250 0x7fe9c00fa520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00f5940 con 0x7fe9c0113180 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00faa60 con 0x7fe9c010cf70 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00fac20 con 0x7fe9c00f5250 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 0x7fe9c0173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 0x7fe9c0173a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:47928/0 (socket says 10.20.193.90:47928) 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 -- 10.20.193.90:0/2642800146 learned_addr learned my addr 10.20.193.90:0/2642800146 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:07:59.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c55796c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9c010cf70 0x7fe9c00f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 -- 10.20.193.90:0/2642800146 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9c00f5250 msgr2=0x7fe9c00fa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9c00f5250 0x7fe9c00fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 -- 10.20.193.90:0/2642800146 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9c010cf70 msgr2=0x7fe9c00f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9c010cf70 0x7fe9c00f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 -- 10.20.193.90:0/2642800146 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b4009590 con 0x7fe9c0113180 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c4d786c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 0x7fe9c0173a20 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b40023c0 tx=0x7fe9b402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9b4002ae0 con 0x7fe9c0113180 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fe9b4002c40 con 0x7fe9c0113180 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c00faea0 con 0x7fe9c0113180 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9b40372f0 con 0x7fe9c0113180 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c00fb370 con 0x7fe9c0113180 2026-02-19T21:07:59.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.964+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c010e240 con 0x7fe9c0113180 2026-02-19T21:07:59.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.966+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fe9b4007810 con 0x7fe9c0113180 2026-02-19T21:07:59.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.967+0000 7fe9ae7fc6c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe99c0b56d0 0x7fe99c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:07:59.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.967+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fe9b4107d80 con 0x7fe9c0113180 2026-02-19T21:07:59.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.967+0000 7fe9c55796c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe99c0b56d0 0x7fe99c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:07:59.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.967+0000 7fe9c55796c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe99c0b56d0 0x7fe99c0d5b80 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b0005980 tx=0x7fe9b0005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:07:59.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:07:59.967+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe9b40ca730 con 0x7fe9c0113180 2026-02-19T21:08:00.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:07:59 trial175 ceph-mon[34116]: pgmap v285: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:00.082 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.081+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe9c010d340 con 0x7fe9c0113180 2026-02-19T21:08:00.083 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:07:59 trial090 ceph-mon[31759]: pgmap v285: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:00.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.081+0000 7fe9ae7fc6c0 1 -- 10.20.193.90:0/2642800146 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe9b4007e60 con 0x7fe9c0113180 2026-02-19T21:08:00.084 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:00.084 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe99c0b56d0 msgr2=0x7fe99c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe99c0b56d0 0x7fe99c0d5b80 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b0005980 tx=0x7fe9b0005910 comp rx=0 tx=0).stop 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 msgr2=0x7fe9c0173a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 0x7fe9c0173a20 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9b40023c0 tx=0x7fe9b402fbf0 comp rx=0 tx=0).stop 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 shutdown_connections 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fe99c0b56d0 0x7fe99c0d5b80 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fe9c00f5250 0x7fe9c00fa520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fe9c0113180 0x7fe9c0173a20 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 --2- 10.20.193.90:0/2642800146 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fe9c010cf70 0x7fe9c00f4c20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:00.085 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 >> 10.20.193.90:0/2642800146 conn(0x7fe9c00ea870 msgr2=0x7fe9c010b490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:00.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 shutdown_connections 2026-02-19T21:08:00.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:00.082+0000 7fe9c78046c0 1 -- 10.20.193.90:0/2642800146 wait complete. 2026-02-19T21:08:00.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:07:59 trial105 ceph-mon[33883]: pgmap v285: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:01.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:00 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2642800146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:01.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:00 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2642800146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:01.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:00 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2642800146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:02.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:01 trial175 ceph-mon[34116]: pgmap v286: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:02.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:01 trial105 ceph-mon[33883]: pgmap v286: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:02.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:01 trial090 ceph-mon[31759]: pgmap v286: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:03.122 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:03.247 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2660760517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 msgr2=0x7f3bd4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2660760517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd4175db0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=14314557490566249654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bc400aa70 tx=0x7f3bc402fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2660760517 shutdown_connections 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2660760517 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd4175db0 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=14314557490566249654 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2660760517 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3bd410fbf0 0x7f3bd4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2660760517 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd410f200 0x7f3bd410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2660760517 >> 10.20.193.90:0/2660760517 conn(0x7f3bd40eca60 msgr2=0x7f3bd410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:03.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2660760517 shutdown_connections 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2660760517 wait complete. 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 Processor -- start 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 -- start start 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3bd410f200 0x7f3bd411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.365+0000 7f3bd94e16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd411d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd4122b90 0x7f3bd4123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41235a0 con 0x7f3bd4115410 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4123710 con 0x7f3bd410f200 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd41238d0 con 0x7f3bd4122b90 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd411d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd411d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:47940/0 (socket says 10.20.193.90:47940) 2026-02-19T21:08:03.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 -- 10.20.193.90:0/2852061132 learned_addr learned my addr 10.20.193.90:0/2852061132 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd2ffd6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3bd410f200 0x7f3bd411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd37fe6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd4122b90 0x7f3bd4123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 -- 10.20.193.90:0/2852061132 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd4122b90 msgr2=0x7f3bd4123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd4122b90 0x7f3bd4123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 -- 10.20.193.90:0/2852061132 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3bd410f200 msgr2=0x7f3bd411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3bd410f200 0x7f3bd411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 -- 10.20.193.90:0/2852061132 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc400a660 con 0x7f3bd4115410 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd37fe6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd4122b90 0x7f3bd4123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd27fc6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd411d7d0 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bbc005dc0 tx=0x7f3bbc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bbc004250 con 0x7f3bd4115410 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd4163d80 con 0x7f3bd4115410 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3bbc009070 con 0x7f3bd4115410 2026-02-19T21:08:03.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3bbc00cd50 con 0x7f3bd4115410 2026-02-19T21:08:03.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd4164210 con 0x7f3bd4115410 2026-02-19T21:08:03.372 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.366+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd41104d0 con 0x7f3bd4115410 2026-02-19T21:08:03.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.368+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f3bbc0028c0 con 0x7f3bd4115410 2026-02-19T21:08:03.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.369+0000 7f3bb3fff6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3ba80b5650 0x7f3ba80d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:03.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.369+0000 7f3bd2ffd6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3ba80b5650 0x7f3ba80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:03.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.369+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f3bbc0e3b80 con 0x7f3bd4115410 2026-02-19T21:08:03.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.369+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3bbc11c660 con 0x7f3bd4115410 2026-02-19T21:08:03.373 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.369+0000 7f3bd2ffd6c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3ba80b5650 0x7f3ba80d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bc8005980 tx=0x7f3bc8005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:03.485 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.484+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3bd411e3e0 con 0x7f3bd4115410 2026-02-19T21:08:03.486 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.484+0000 7f3bb3fff6c0 1 -- 10.20.193.90:0/2852061132 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f3bbc0a6570 con 0x7f3bd4115410 2026-02-19T21:08:03.486 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:03.486 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:03.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3ba80b5650 msgr2=0x7f3ba80d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:03.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3ba80b5650 0x7f3ba80d5b00 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bc8005980 tx=0x7f3bc8005910 comp rx=0 tx=0).stop 2026-02-19T21:08:03.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 msgr2=0x7f3bd411d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:03.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd411d7d0 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3bbc005dc0 tx=0x7f3bbc00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 shutdown_connections 2026-02-19T21:08:03.487 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f3ba80b5650 0x7f3ba80d5b00 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3bd4122b90 0x7f3bd4123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3bd4115410 0x7f3bd411d7d0 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 --2- 10.20.193.90:0/2852061132 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3bd410f200 0x7f3bd411d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:03.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 >> 10.20.193.90:0/2852061132 conn(0x7f3bd40eca60 msgr2=0x7f3bd410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:03.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 shutdown_connections 2026-02-19T21:08:03.488 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:03.485+0000 7f3bd94e16c0 1 -- 10.20.193.90:0/2852061132 wait complete. 2026-02-19T21:08:04.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:03 trial175 ceph-mon[34116]: pgmap v287: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:04.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:03 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2852061132' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:04.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:03 trial105 ceph-mon[33883]: pgmap v287: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:04.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:03 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2852061132' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:04.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:03 trial090 ceph-mon[31759]: pgmap v287: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:04.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:03 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2852061132' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:06.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:05 trial175 ceph-mon[34116]: pgmap v288: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:06.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:05 trial105 ceph-mon[33883]: pgmap v288: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:06.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:05 trial090 ceph-mon[31759]: pgmap v288: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:06.526 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:06.649 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:06.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 -- 10.20.193.90:0/1413739473 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b410d960 msgr2=0x7f30b41129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:06.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 --2- 10.20.193.90:0/1413739473 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b410d960 0x7f30b41129a0 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=10585063324687444503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f309c0099a0 tx=0x7f309c02ed50 comp rx=0 tx=0).stop 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 -- 10.20.193.90:0/1413739473 shutdown_connections 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 --2- 10.20.193.90:0/1413739473 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4113180 0x7f30b4173b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 --2- 10.20.193.90:0/1413739473 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b410d960 0x7f30b41129a0 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=10585063324687444503 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 --2- 10.20.193.90:0/1413739473 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 0x7f30b410d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 -- 10.20.193.90:0/1413739473 >> 10.20.193.90:0/1413739473 conn(0x7f30b40ea870 msgr2=0x7f30b410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 -- 10.20.193.90:0/1413739473 shutdown_connections 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.761+0000 7f30b95816c0 1 -- 10.20.193.90:0/1413739473 wait complete. 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 Processor -- start 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 -- start start 2026-02-19T21:08:06.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 0x7f30b40606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 0x7f30b4173a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4060c00 0x7f30b40610a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30b4062600 con 0x7f30b4113180 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40fac30 con 0x7f30b410cf70 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40fadf0 con 0x7f30b4060c00 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 0x7f30b4173a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 0x7f30b4173a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54552/0 (socket says 10.20.193.90:54552) 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 -- 10.20.193.90:0/3044115992 learned_addr learned my addr 10.20.193.90:0/3044115992 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 -- 10.20.193.90:0/3044115992 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4060c00 msgr2=0x7f30b40610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b2ffd6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 0x7f30b40606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:06.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b37fe6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4060c00 0x7f30b40610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4060c00 0x7f30b40610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 -- 10.20.193.90:0/3044115992 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 msgr2=0x7f30b40606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 0x7f30b40606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 -- 10.20.193.90:0/3044115992 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c009590 con 0x7f30b4113180 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b2ffd6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 0x7f30b40606c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b37fe6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4060c00 0x7f30b40610a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b27fc6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 0x7f30b4173a20 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f309c02f8e0 tx=0x7f309c02fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f309c002c20 con 0x7f30b4113180 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f309c002d80 con 0x7f30b4113180 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b40fb070 con 0x7f30b4113180 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f309c0312b0 con 0x7f30b4113180 2026-02-19T21:08:06.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.762+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b40fb540 con 0x7f30b4113180 2026-02-19T21:08:06.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.763+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b410e240 con 0x7f30b4113180 2026-02-19T21:08:06.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.764+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f309c007910 con 0x7f30b4113180 2026-02-19T21:08:06.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.765+0000 7f3093fff6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f30880b56d0 0x7f30880d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:06.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.765+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f309c107f80 con 0x7f30b4113180 2026-02-19T21:08:06.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.765+0000 7f30b2ffd6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f30880b56d0 0x7f30880d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:06.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.765+0000 7f30b2ffd6c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f30880b56d0 0x7f30880d5b80 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30a8004750 tx=0x7f30a8005e50 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:06.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.765+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f309c0ca930 con 0x7f30b4113180 2026-02-19T21:08:06.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.882+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f30b40619c0 con 0x7f30b4113180 2026-02-19T21:08:06.884 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.882+0000 7f3093fff6c0 1 -- 10.20.193.90:0/3044115992 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f309c0cdae0 con 0x7f30b4113180 2026-02-19T21:08:06.884 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:06.884 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:06.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f30880b56d0 msgr2=0x7f30880d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:06.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f30880b56d0 0x7f30880d5b80 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30a8004750 tx=0x7f30a8005e50 comp rx=0 tx=0).stop 2026-02-19T21:08:06.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 msgr2=0x7f30b4173a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 0x7f30b4173a20 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f309c02f8e0 tx=0x7f309c02fce0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 shutdown_connections 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f30880b56d0 0x7f30880d5b80 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f30b4060c00 0x7f30b40610a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f30b4113180 0x7f30b4173a20 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 --2- 10.20.193.90:0/3044115992 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f30b410cf70 0x7f30b40606c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.883+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 >> 10.20.193.90:0/3044115992 conn(0x7f30b40ea870 msgr2=0x7f30b41119e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.884+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 shutdown_connections 2026-02-19T21:08:06.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:06.884+0000 7f30b95816c0 1 -- 10.20.193.90:0/3044115992 wait complete. 2026-02-19T21:08:08.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:07 trial175 ceph-mon[34116]: pgmap v289: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:08.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:07 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3044115992' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:08.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:07 trial105 ceph-mon[33883]: pgmap v289: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:08.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:07 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3044115992' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:08.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:07 trial090 ceph-mon[31759]: pgmap v289: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:08.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:07 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3044115992' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:09.924 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:10.016 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:09 trial175 ceph-mon[34116]: pgmap v290: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:10.046 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:10.067 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:09 trial090 ceph-mon[31759]: pgmap v290: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:10.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:09 trial105 ceph-mon[33883]: pgmap v290: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:10.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 -- 10.20.193.90:0/3750456899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 msgr2=0x7f1510175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:10.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 --2- 10.20.193.90:0/3750456899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f1510175db0 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=13245389409339810948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f150400aa70 tx=0x7f150402fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 -- 10.20.193.90:0/3750456899 shutdown_connections 2026-02-19T21:08:10.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 --2- 10.20.193.90:0/3750456899 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f1510175db0 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=13245389409339810948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.162 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 --2- 10.20.193.90:0/3750456899 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f151010fbf0 0x7f1510114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 --2- 10.20.193.90:0/3750456899 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 0x7f151010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 -- 10.20.193.90:0/3750456899 >> 10.20.193.90:0/3750456899 conn(0x7f15100ecac0 msgr2=0x7f151010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 -- 10.20.193.90:0/3750456899 shutdown_connections 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.158+0000 7f15162076c0 1 -- 10.20.193.90:0/3750456899 wait complete. 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 Processor -- start 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 -- start start 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 0x7f151011d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f151011d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1510122b90 0x7f1510123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15101235a0 con 0x7f1510115410 2026-02-19T21:08:10.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1510123710 con 0x7f1510122b90 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f15101238d0 con 0x7f151010f200 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f151011d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f151011d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54574/0 (socket says 10.20.193.90:54574) 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 -- 10.20.193.90:0/1079406068 learned_addr learned my addr 10.20.193.90:0/1079406068 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150f7fe6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 0x7f151011d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 -- 10.20.193.90:0/1079406068 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 msgr2=0x7f151011d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 0x7f151011d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150ffff6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1510122b90 0x7f1510123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 -- 10.20.193.90:0/1079406068 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1510122b90 msgr2=0x7f1510123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1510122b90 0x7f1510123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 -- 10.20.193.90:0/1079406068 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150400a660 con 0x7f1510115410 2026-02-19T21:08:10.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150f7fe6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 0x7f151011d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150ffff6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1510122b90 0x7f1510123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150effd6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f151011d7d0 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1500005dc0 tx=0x7f150000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1500004250 con 0x7f1510115410 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1500009070 con 0x7f1510115410 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f150000cd50 con 0x7f1510115410 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1510163d80 con 0x7f1510115410 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.159+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1510164210 con 0x7f1510115410 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.160+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15101104d0 con 0x7f1510115410 2026-02-19T21:08:10.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.161+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f15000028c0 con 0x7f1510115410 2026-02-19T21:08:10.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.161+0000 7f150cff96c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14e40b56d0 0x7f14e40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:10.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.162+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f15000e3b20 con 0x7f1510115410 2026-02-19T21:08:10.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.162+0000 7f150f7fe6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14e40b56d0 0x7f14e40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:10.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.162+0000 7f150f7fe6c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14e40b56d0 0x7f14e40d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14fc004750 tx=0x7f14fc009630 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:10.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.162+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f15000a64d0 con 0x7f1510115410 2026-02-19T21:08:10.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.278+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f151010f5d0 con 0x7f1510115410 2026-02-19T21:08:10.279 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.278+0000 7f150cff96c0 1 -- 10.20.193.90:0/1079406068 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f15000a9680 con 0x7f1510115410 2026-02-19T21:08:10.280 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:10.280 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14e40b56d0 msgr2=0x7f14e40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14e40b56d0 0x7f14e40d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f14fc004750 tx=0x7f14fc009630 comp rx=0 tx=0).stop 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 msgr2=0x7f151011d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f151011d7d0 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1500005dc0 tx=0x7f150000bbb0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 shutdown_connections 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f14e40b56d0 0x7f14e40d5b80 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1510122b90 0x7f1510123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1510115410 0x7f151011d7d0 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 --2- 10.20.193.90:0/1079406068 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f151010f200 0x7f151011d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:10.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 >> 10.20.193.90:0/1079406068 conn(0x7f15100ecac0 msgr2=0x7f151010cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:10.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 shutdown_connections 2026-02-19T21:08:10.282 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:10.279+0000 7f15162076c0 1 -- 10.20.193.90:0/1079406068 wait complete. 2026-02-19T21:08:11.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:10 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1079406068' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:11.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:10 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1079406068' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:11.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:10 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1079406068' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:12.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:11 trial105 ceph-mon[33883]: pgmap v291: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:12.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:11 trial090 ceph-mon[31759]: pgmap v291: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:12.265 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:11 trial175 ceph-mon[34116]: pgmap v291: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:13.320 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:13.449 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:13.565 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- 10.20.193.90:0/3752468708 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94113170 msgr2=0x7f1b94173b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:13.565 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- 10.20.193.90:0/3752468708 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94113170 0x7f1b94173b10 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=13456272246574474627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b8400aa70 tx=0x7f1b8402fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.565 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- 10.20.193.90:0/3752468708 shutdown_connections 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- 10.20.193.90:0/3752468708 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94113170 0x7f1b94173b10 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=13456272246574474627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- 10.20.193.90:0/3752468708 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1b9410d950 0x7f1b94112990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- 10.20.193.90:0/3752468708 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1b9410cf60 0x7f1b9410d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- 10.20.193.90:0/3752468708 >> 10.20.193.90:0/3752468708 conn(0x7f1b940ea840 msgr2=0x7f1b9410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- 10.20.193.90:0/3752468708 shutdown_connections 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- 10.20.193.90:0/3752468708 wait complete. 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 Processor -- start 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- start start 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1b9410cf60 0x7f1b9411af40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:13.566 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1b94113170 0x7f1b9411b480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 0x7f1b94120ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1b94121220 con 0x7f1b94120840 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1b94121390 con 0x7f1b94113170 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b997316c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1b94121550 con 0x7f1b9410cf60 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b937fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 0x7f1b94120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b937fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 0x7f1b94120ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54584/0 (socket says 10.20.193.90:54584) 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b937fe6c0 1 -- 10.20.193.90:0/1720220795 learned_addr learned my addr 10.20.193.90:0/1720220795 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b937fe6c0 1 -- 10.20.193.90:0/1720220795 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1b9410cf60 msgr2=0x7f1b9411af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.562+0000 7f1b937fe6c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1b9410cf60 0x7f1b9411af40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b937fe6c0 1 -- 10.20.193.90:0/1720220795 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1b94113170 msgr2=0x7f1b9411b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b937fe6c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1b94113170 0x7f1b9411b480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.567 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b937fe6c0 1 -- 10.20.193.90:0/1720220795 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8400a660 con 0x7f1b94120840 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b937fe6c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 0x7f1b94120ce0 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b840054b0 tx=0x7f1b840054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b84003a30 con 0x7f1b94120840 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1b84003b90 con 0x7f1b94120840 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b941619d0 con 0x7f1b94120840 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1b840382f0 con 0x7f1b94120840 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b94161e50 con 0x7f1b94120840 2026-02-19T21:08:13.568 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.563+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9410e230 con 0x7f1b94120840 2026-02-19T21:08:13.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.564+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f1b84008260 con 0x7f1b94120840 2026-02-19T21:08:13.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.565+0000 7f1b73fff6c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1b680b56d0 0x7f1b680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:13.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.565+0000 7f1b92ffd6c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1b680b56d0 0x7f1b680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:13.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.565+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f1b84108f20 con 0x7f1b94120840 2026-02-19T21:08:13.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.565+0000 7f1b92ffd6c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1b680b56d0 0x7f1b680d5b80 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b88005980 tx=0x7f1b88005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:13.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.566+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1b840cea80 con 0x7f1b94120840 2026-02-19T21:08:13.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.679+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1b9410d330 con 0x7f1b94120840 2026-02-19T21:08:13.681 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b73fff6c0 1 -- 10.20.193.90:0/1720220795 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1b840cec60 con 0x7f1b94120840 2026-02-19T21:08:13.681 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:13.682 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:13.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1b680b56d0 msgr2=0x7f1b680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:13.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1b680b56d0 0x7f1b680d5b80 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b88005980 tx=0x7f1b88005910 comp rx=0 tx=0).stop 2026-02-19T21:08:13.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 msgr2=0x7f1b94120ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:13.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 0x7f1b94120ce0 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1b840054b0 tx=0x7f1b840054e0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 shutdown_connections 2026-02-19T21:08:13.683 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f1b680b56d0 0x7f1b680d5b80 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f1b94120840 0x7f1b94120ce0 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f1b94113170 0x7f1b9411b480 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 --2- 10.20.193.90:0/1720220795 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f1b9410cf60 0x7f1b9411af40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:13.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.680+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 >> 10.20.193.90:0/1720220795 conn(0x7f1b940ea840 msgr2=0x7f1b9410ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:13.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.681+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 shutdown_connections 2026-02-19T21:08:13.684 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:13.681+0000 7f1b997316c0 1 -- 10.20.193.90:0/1720220795 wait complete. 2026-02-19T21:08:14.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:13 trial105 ceph-mon[33883]: pgmap v292: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:14.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:13 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1720220795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:14.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:13 trial090 ceph-mon[31759]: pgmap v292: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:14.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:13 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1720220795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:14.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:13 trial175 ceph-mon[34116]: pgmap v292: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:14.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:13 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1720220795' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:16.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:15 trial105 ceph-mon[33883]: pgmap v293: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:16.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:15 trial090 ceph-mon[31759]: pgmap v293: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:16.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:15 trial175 ceph-mon[34116]: pgmap v293: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:16.721 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:16.847 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:16.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.960+0000 7f31466b96c0 1 -- 10.20.193.90:0/3056526435 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010fbf0 msgr2=0x7f3140114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.960+0000 7f31466b96c0 1 --2- 10.20.193.90:0/3056526435 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010fbf0 0x7f3140114c30 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=7853882268631854470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31300099a0 tx=0x7f313002ed20 comp rx=0 tx=0).stop 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.960+0000 7f31466b96c0 1 -- 10.20.193.90:0/3056526435 shutdown_connections 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.960+0000 7f31466b96c0 1 --2- 10.20.193.90:0/3056526435 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3140115410 0x7f3140175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 --2- 10.20.193.90:0/3056526435 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010fbf0 0x7f3140114c30 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=7853882268631854470 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 --2- 10.20.193.90:0/3056526435 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f314010f200 0x7f314010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- 10.20.193.90:0/3056526435 >> 10.20.193.90:0/3056526435 conn(0x7f31400ecac0 msgr2=0x7f314010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- 10.20.193.90:0/3056526435 shutdown_connections 2026-02-19T21:08:16.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- 10.20.193.90:0/3056526435 wait complete. 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 Processor -- start 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- start start 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 0x7f31400f4cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3140115410 0x7f3140175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f31400f52e0 0x7f31400fa560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31400f59d0 con 0x7f314010f200 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31400faaa0 con 0x7f3140115410 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31400fac60 con 0x7f31400f52e0 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 0x7f31400f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 0x7f31400f4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52314/0 (socket says 10.20.193.90:52314) 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 -- 10.20.193.90:0/916060762 learned_addr learned my addr 10.20.193.90:0/916060762 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:16.966 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313f7fe6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3140115410 0x7f3140175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 -- 10.20.193.90:0/916060762 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f31400f52e0 msgr2=0x7f31400fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f31400f52e0 0x7f31400fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 -- 10.20.193.90:0/916060762 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3140115410 msgr2=0x7f3140175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3140115410 0x7f3140175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 -- 10.20.193.90:0/916060762 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3130009590 con 0x7f314010f200 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313ffff6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 0x7f31400f4cb0 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312c00b710 tx=0x7f312c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f312c004250 con 0x7f314010f200 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f312c002d80 con 0x7f314010f200 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31400faf40 con 0x7f314010f200 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f312c00cda0 con 0x7f314010f200 2026-02-19T21:08:16.967 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.961+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31400fb6d0 con 0x7f314010f200 2026-02-19T21:08:16.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.962+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31401104d0 con 0x7f314010f200 2026-02-19T21:08:16.968 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.963+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f312c0028c0 con 0x7f314010f200 2026-02-19T21:08:16.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.964+0000 7f313d7fa6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31140b5650 0x7f31140d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:16.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.964+0000 7f313f7fe6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31140b5650 0x7f31140d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:16.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.964+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f312c0e3c60 con 0x7f314010f200 2026-02-19T21:08:16.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.964+0000 7f313f7fe6c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31140b5650 0x7f31140d5b00 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3130005b40 tx=0x7f31300092a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:16.969 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:16.965+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f312c0a6610 con 0x7f314010f200 2026-02-19T21:08:17.081 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.079+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31400f5de0 con 0x7f314010f200 2026-02-19T21:08:17.081 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.080+0000 7f313d7fa6c0 1 -- 10.20.193.90:0/916060762 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f312c0a97c0 con 0x7f314010f200 2026-02-19T21:08:17.082 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:17.082 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:17.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.080+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31140b5650 msgr2=0x7f31140d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:17.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.080+0000 7f31466b96c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31140b5650 0x7f31140d5b00 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3130005b40 tx=0x7f31300092a0 comp rx=0 tx=0).stop 2026-02-19T21:08:17.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.080+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 msgr2=0x7f31400f4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:17.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.080+0000 7f31466b96c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 0x7f31400f4cb0 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f312c00b710 tx=0x7f312c00bbe0 comp rx=0 tx=0).stop 2026-02-19T21:08:17.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 shutdown_connections 2026-02-19T21:08:17.083 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f31140b5650 0x7f31140d5b00 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:17.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f31400f52e0 0x7f31400fa560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:17.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3140115410 0x7f3140175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:17.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 --2- 10.20.193.90:0/916060762 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f314010f200 0x7f31400f4cb0 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:17.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 >> 10.20.193.90:0/916060762 conn(0x7f31400ecac0 msgr2=0x7f314010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:17.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 shutdown_connections 2026-02-19T21:08:17.084 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:17.081+0000 7f31466b96c0 1 -- 10.20.193.90:0/916060762 wait complete. 2026-02-19T21:08:18.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:17 trial105 ceph-mon[33883]: pgmap v294: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:18.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:17 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/916060762' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:18.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:17 trial090 ceph-mon[31759]: pgmap v294: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:18.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:17 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/916060762' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:18.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:17 trial175 ceph-mon[34116]: pgmap v294: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:18.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:17 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/916060762' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:20.122 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:20.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:19 trial105 ceph-mon[33883]: pgmap v295: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:20.149 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:19 trial090 ceph-mon[31759]: pgmap v295: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:20.248 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:20.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:19 trial175 ceph-mon[34116]: pgmap v295: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- 10.20.193.90:0/2907768058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 msgr2=0x7f780410d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- 10.20.193.90:0/2907768058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780410d340 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=16869348013402683822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77f80099a0 tx=0x7f77f802ed20 comp rx=0 tx=0).stop 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- 10.20.193.90:0/2907768058 shutdown_connections 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- 10.20.193.90:0/2907768058 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7804113180 0x7f7804173b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- 10.20.193.90:0/2907768058 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f780410d960 0x7f78041129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- 10.20.193.90:0/2907768058 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780410d340 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=16869348013402683822 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- 10.20.193.90:0/2907768058 >> 10.20.193.90:0/2907768058 conn(0x7f78040ea870 msgr2=0x7f780410ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- 10.20.193.90:0/2907768058 shutdown_connections 2026-02-19T21:08:20.360 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- 10.20.193.90:0/2907768058 wait complete. 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 Processor -- start 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- start start 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780411b080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7804113180 0x7f780411b5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7804120980 0x7f7804120e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7804121390 con 0x7f780410cf70 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7804121500 con 0x7f7804113180 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f780971c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78041216c0 con 0x7f7804120980 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780411b080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780411b080 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52340/0 (socket says 10.20.193.90:52340) 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 -- 10.20.193.90:0/3364328595 learned_addr learned my addr 10.20.193.90:0/3364328595 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:20.361 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f78037fe6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7804120980 0x7f7804120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 -- 10.20.193.90:0/3364328595 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7804120980 msgr2=0x7f7804120e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7804120980 0x7f7804120e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 -- 10.20.193.90:0/3364328595 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7804113180 msgr2=0x7f780411b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7804113180 0x7f780411b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 -- 10.20.193.90:0/3364328595 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f8009590 con 0x7f780410cf70 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.356+0000 7f7802ffd6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780411b080 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77f802f230 tx=0x7f77f802fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.357+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77f8002ba0 con 0x7f780410cf70 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.357+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f77f8002d00 con 0x7f780410cf70 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.357+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7804161b10 con 0x7f780410cf70 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.357+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f77f80372f0 con 0x7f780410cf70 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.357+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7804161f90 con 0x7f780410cf70 2026-02-19T21:08:20.362 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.357+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780410e240 con 0x7f780410cf70 2026-02-19T21:08:20.363 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.359+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f77f80078d0 con 0x7f780410cf70 2026-02-19T21:08:20.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.359+0000 7f77e3fff6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77d80b56d0 0x7f77d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:20.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.359+0000 7f78027fc6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77d80b56d0 0x7f77d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:20.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.359+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f77f8107ce0 con 0x7f780410cf70 2026-02-19T21:08:20.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.360+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77f80ca690 con 0x7f780410cf70 2026-02-19T21:08:20.364 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.360+0000 7f78027fc6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77d80b56d0 0x7f77d80d5b80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7804121a10 tx=0x7f77ec005cb0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.475+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f780410d340 con 0x7f780410cf70 2026-02-19T21:08:20.477 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.475+0000 7f77e3fff6c0 1 -- 10.20.193.90:0/3364328595 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f77f80cd840 con 0x7f780410cf70 2026-02-19T21:08:20.477 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:20.477 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77d80b56d0 msgr2=0x7f77d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77d80b56d0 0x7f77d80d5b80 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7804121a10 tx=0x7f77ec005cb0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.478 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 msgr2=0x7f780411b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780411b080 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77f802f230 tx=0x7f77f802fd40 comp rx=0 tx=0).stop 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 shutdown_connections 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f77d80b56d0 0x7f77d80d5b80 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7804120980 0x7f7804120e20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7804113180 0x7f780411b5c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 --2- 10.20.193.90:0/3364328595 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f780410cf70 0x7f780411b080 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 >> 10.20.193.90:0/3364328595 conn(0x7f78040ea870 msgr2=0x7f780410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 shutdown_connections 2026-02-19T21:08:20.479 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:20.476+0000 7f780971c6c0 1 -- 10.20.193.90:0/3364328595 wait complete. 2026-02-19T21:08:21.045 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:20 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3364328595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:21.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:20 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3364328595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:21.265 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:20 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3364328595' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:22.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:21 trial105 ceph-mon[33883]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:22.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:21 trial090 ceph-mon[31759]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:22.265 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:21 trial175 ceph-mon[34116]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:23.516 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:23.643 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:23.765 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 -- 10.20.193.90:0/1954445169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 msgr2=0x7f889010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 --2- 10.20.193.90:0/1954445169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889010f5d0 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=2824061187246175840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88800099a0 tx=0x7f888002ed20 comp rx=0 tx=0).stop 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 -- 10.20.193.90:0/1954445169 shutdown_connections 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 --2- 10.20.193.90:0/1954445169 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8890115410 0x7f8890175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 --2- 10.20.193.90:0/1954445169 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f889010fbf0 0x7f8890114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 --2- 10.20.193.90:0/1954445169 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889010f5d0 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=2824061187246175840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 -- 10.20.193.90:0/1954445169 >> 10.20.193.90:0/1954445169 conn(0x7f88900eca60 msgr2=0x7f889010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 -- 10.20.193.90:0/1954445169 shutdown_connections 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.762+0000 7f8896e306c0 1 -- 10.20.193.90:0/1954445169 wait complete. 2026-02-19T21:08:23.766 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 Processor -- start 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 -- start start 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889011d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8890115410 0x7f889011d780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8890122b40 0x7f8890122fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8890123550 con 0x7f889010f200 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88901236c0 con 0x7f8890115410 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8890123880 con 0x7f8890122b40 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889011d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889011d240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52362/0 (socket says 10.20.193.90:52362) 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 -- 10.20.193.90:0/2412827854 learned_addr learned my addr 10.20.193.90:0/2412827854 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f88953a26c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8890122b40 0x7f8890122fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:23.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8887fff6c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8890115410 0x7f889011d780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 -- 10.20.193.90:0/2412827854 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8890122b40 msgr2=0x7f8890122fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8890122b40 0x7f8890122fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 -- 10.20.193.90:0/2412827854 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8890115410 msgr2=0x7f889011d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8890115410 0x7f889011d780 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 -- 10.20.193.90:0/2412827854 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8880009590 con 0x7f889010f200 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8894ba16c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889011d240 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888002f230 tx=0x7f888002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8880002ba0 con 0x7f889010f200 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8880002d00 con 0x7f889010f200 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8890163cd0 con 0x7f889010f200 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88800372f0 con 0x7f889010f200 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.763+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8890164150 con 0x7f889010f200 2026-02-19T21:08:23.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.764+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88901104d0 con 0x7f889010f200 2026-02-19T21:08:23.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.765+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f88800078d0 con 0x7f889010f200 2026-02-19T21:08:23.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.766+0000 7f8885ffb6c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f886c0b56d0 0x7f886c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:23.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.766+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f8880107d40 con 0x7f889010f200 2026-02-19T21:08:23.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.766+0000 7f8887fff6c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f886c0b56d0 0x7f886c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:23.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.766+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8880108230 con 0x7f889010f200 2026-02-19T21:08:23.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.766+0000 7f8887fff6c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f886c0b56d0 0x7f886c0d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8878005980 tx=0x7f8878005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:23.882 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.881+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f889010fbf0 con 0x7f889010f200 2026-02-19T21:08:23.883 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:23 trial090 ceph-mon[31759]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:23.883 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.881+0000 7f8885ffb6c0 1 -- 10.20.193.90:0/2412827854 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f88800ca730 con 0x7f889010f200 2026-02-19T21:08:23.883 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:23.884 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f886c0b56d0 msgr2=0x7f886c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f886c0b56d0 0x7f886c0d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8878005980 tx=0x7f8878005910 comp rx=0 tx=0).stop 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 msgr2=0x7f889011d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889011d240 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f888002f230 tx=0x7f888002fd40 comp rx=0 tx=0).stop 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 shutdown_connections 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f886c0b56d0 0x7f886c0d5b80 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f8890122b40 0x7f8890122fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f8890115410 0x7f889011d780 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 --2- 10.20.193.90:0/2412827854 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f889010f200 0x7f889011d240 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 >> 10.20.193.90:0/2412827854 conn(0x7f88900eca60 msgr2=0x7f889010ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:23.885 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 shutdown_connections 2026-02-19T21:08:23.886 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:23.882+0000 7f8896e306c0 1 -- 10.20.193.90:0/2412827854 wait complete. 2026-02-19T21:08:24.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:23 trial105 ceph-mon[33883]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:24.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:23 trial175 ceph-mon[34116]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:25.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:24 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2412827854' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:25.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:24 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2412827854' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:25.166 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:24 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2412827854' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:26.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:25 trial105 ceph-mon[33883]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:26.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:25 trial090 ceph-mon[31759]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:26.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:25 trial175 ceph-mon[34116]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:26.922 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:27.054 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:27.163 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 -- 10.20.193.90:0/3325723158 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70114150 msgr2=0x7fdf70119100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3325723158 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70114150 0x7fdf70119100 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=4420703908976918959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf60009970 tx=0x7fdf6002ed20 comp rx=0 tx=0).stop 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 -- 10.20.193.90:0/3325723158 shutdown_connections 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3325723158 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdf701198b0 0x7fdf7017a280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3325723158 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70114150 0x7fdf70119100 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=4420703908976918959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3325723158 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdf70113760 0x7fdf70113b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 -- 10.20.193.90:0/3325723158 >> 10.20.193.90:0/3325723158 conn(0x7fdf70060720 msgr2=0x7fdf70060cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 -- 10.20.193.90:0/3325723158 shutdown_connections 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.160+0000 7fdf764856c0 1 -- 10.20.193.90:0/3325723158 wait complete. 2026-02-19T21:08:27.164 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 Processor -- start 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 -- start start 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 0x7fdf70121780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdf701198b0 0x7fdf70121cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdf70127030 0x7fdf701274d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70127a40 con 0x7fdf70113760 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70127bb0 con 0x7fdf70127030 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdf70127d70 con 0x7fdf701198b0 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 0x7fdf70121780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 0x7fdf70121780 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:53204/0 (socket says 10.20.193.90:53204) 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 -- 10.20.193.90:0/3813974291 learned_addr learned my addr 10.20.193.90:0/3813974291 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf749f76c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdf70127030 0x7fdf701274d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:27.165 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 -- 10.20.193.90:0/3813974291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdf701198b0 msgr2=0x7fdf70121cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdf701198b0 0x7fdf70121cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 -- 10.20.193.90:0/3813974291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdf70127030 msgr2=0x7fdf701274d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdf70127030 0x7fdf701274d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 -- 10.20.193.90:0/3813974291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf60009590 con 0x7fdf70113760 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6ffff6c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 0x7fdf70121780 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf5c005dc0 tx=0x7fdf5c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf5c004250 con 0x7fdf70113760 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdf5c009070 con 0x7fdf70113760 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf70168220 con 0x7fdf70113760 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf5c00cd70 con 0x7fdf70113760 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.161+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf701686b0 con 0x7fdf70113760 2026-02-19T21:08:27.166 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.162+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf701149a0 con 0x7fdf70113760 2026-02-19T21:08:27.167 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.163+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fdf5c0028c0 con 0x7fdf70113760 2026-02-19T21:08:27.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.164+0000 7fdf6d7fa6c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdf440b56d0 0x7fdf440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:27.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.164+0000 7fdf6f7fe6c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdf440b56d0 0x7fdf440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:27.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.164+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdf5c0e3b80 con 0x7fdf70113760 2026-02-19T21:08:27.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.164+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdf5c0a6570 con 0x7fdf70113760 2026-02-19T21:08:27.168 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.164+0000 7fdf6f7fe6c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdf440b56d0 0x7fdf440d5b80 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf600098c0 tx=0x7fdf60005bc0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:27.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.279+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdf70113b30 con 0x7fdf70113760 2026-02-19T21:08:27.281 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.280+0000 7fdf6d7fa6c0 1 -- 10.20.193.90:0/3813974291 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdf5c0a9720 con 0x7fdf70113760 2026-02-19T21:08:27.282 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:27.282 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:27.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdf440b56d0 msgr2=0x7fdf440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:27.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdf440b56d0 0x7fdf440d5b80 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf600098c0 tx=0x7fdf60005bc0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 msgr2=0x7fdf70121780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:27.283 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 0x7fdf70121780 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf5c005dc0 tx=0x7fdf5c00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 shutdown_connections 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdf440b56d0 0x7fdf440d5b80 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdf70127030 0x7fdf701274d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdf701198b0 0x7fdf70121cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 --2- 10.20.193.90:0/3813974291 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdf70113760 0x7fdf70121780 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 >> 10.20.193.90:0/3813974291 conn(0x7fdf70060720 msgr2=0x7fdf70117f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 shutdown_connections 2026-02-19T21:08:27.284 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:27.281+0000 7fdf764856c0 1 -- 10.20.193.90:0/3813974291 wait complete. 2026-02-19T21:08:28.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:27 trial105 ceph-mon[33883]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:28.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:27 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3813974291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:28.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:27 trial090 ceph-mon[31759]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:28.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:27 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3813974291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:28.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:27 trial175 ceph-mon[34116]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:28.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:27 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3813974291' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:30.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:29 trial105 ceph-mon[33883]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:30.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:29 trial090 ceph-mon[31759]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:30.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:29 trial175 ceph-mon[34116]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:08:30.324 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:30.451 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:30.569 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 -- 10.20.193.90:0/1594637908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820115410 msgr2=0x7fa820175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/1594637908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820115410 0x7fa820175db0 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=9804449568579692247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa81c00aa70 tx=0x7fa81c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 -- 10.20.193.90:0/1594637908 shutdown_connections 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/1594637908 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820115410 0x7fa820175db0 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=9804449568579692247 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/1594637908 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa82010fbf0 0x7fa820114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/1594637908 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 0x7fa82010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 -- 10.20.193.90:0/1594637908 >> 10.20.193.90:0/1594637908 conn(0x7fa8200eca60 msgr2=0x7fa82010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 -- 10.20.193.90:0/1594637908 shutdown_connections 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.566+0000 7fa82874f6c0 1 -- 10.20.193.90:0/1594637908 wait complete. 2026-02-19T21:08:30.570 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 Processor -- start 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 -- start start 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 0x7fa82011d270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa820115410 0x7fa82011d7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 0x7fa820123010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa820123580 con 0x7fa820122b70 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201236f0 con 0x7fa82010f200 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8201238b0 con 0x7fa820115410 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 0x7fa820123010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 0x7fa820123010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:53230/0 (socket says 10.20.193.90:53230) 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 -- 10.20.193.90:0/2130170178 learned_addr learned my addr 10.20.193.90:0/2130170178 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:30.571 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 -- 10.20.193.90:0/2130170178 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa820115410 msgr2=0x7fa82011d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa820115410 0x7fa82011d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa8264c06c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 0x7fa82011d270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 -- 10.20.193.90:0/2130170178 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 msgr2=0x7fa82011d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 0x7fa82011d270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 -- 10.20.193.90:0/2130170178 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c00a660 con 0x7fa820122b70 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa8264c06c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 0x7fa82011d270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa826cc16c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 0x7fa820123010 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa81c0054b0 tx=0x7fa81c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa81c003a30 con 0x7fa820122b70 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa820163d00 con 0x7fa820122b70 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa81c003b90 con 0x7fa820122b70 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa81c0382f0 con 0x7fa820122b70 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.567+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa820164130 con 0x7fa820122b70 2026-02-19T21:08:30.572 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.568+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8201104d0 con 0x7fa820122b70 2026-02-19T21:08:30.573 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.569+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fa81c008260 con 0x7fa820122b70 2026-02-19T21:08:30.574 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.570+0000 7fa8077fe6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7fc0b56d0 0x7fa7fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:30.574 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.570+0000 7fa8264c06c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7fc0b56d0 0x7fa7fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:30.574 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.570+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fa81c108f70 con 0x7fa820122b70 2026-02-19T21:08:30.574 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.570+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa81c0ceb10 con 0x7fa820122b70 2026-02-19T21:08:30.574 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.570+0000 7fa8264c06c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7fc0b56d0 0x7fa7fc0d5b80 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa810005dc0 tx=0x7fa810005f90 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:30.687 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.686+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa82010f5d0 con 0x7fa820122b70 2026-02-19T21:08:30.688 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.686+0000 7fa8077fe6c0 1 -- 10.20.193.90:0/2130170178 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa81c0cecf0 con 0x7fa820122b70 2026-02-19T21:08:30.688 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:30.688 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7fc0b56d0 msgr2=0x7fa7fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7fc0b56d0 0x7fa7fc0d5b80 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa810005dc0 tx=0x7fa810005f90 comp rx=0 tx=0).stop 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 msgr2=0x7fa820123010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 0x7fa820123010 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa81c0054b0 tx=0x7fa81c0054e0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 shutdown_connections 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa7fc0b56d0 0x7fa7fc0d5b80 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.689 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa820122b70 0x7fa820123010 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa820115410 0x7fa82011d7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 --2- 10.20.193.90:0/2130170178 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa82010f200 0x7fa82011d270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:30.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 >> 10.20.193.90:0/2130170178 conn(0x7fa8200eca60 msgr2=0x7fa82010ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:30.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 shutdown_connections 2026-02-19T21:08:30.690 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:30.687+0000 7fa82874f6c0 1 -- 10.20.193.90:0/2130170178 wait complete. 2026-02-19T21:08:31.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:30 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2130170178' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:31.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:30 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2130170178' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:31.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:30 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2130170178' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:32.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:31 trial105 ceph-mon[33883]: pgmap v301: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:32.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:31 trial090 ceph-mon[31759]: pgmap v301: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:32.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:31 trial175 ceph-mon[34116]: pgmap v301: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:33.081 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:08:33.082 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:08:33.082 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:08:33.082 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:08:33.082 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:08:33.082 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:08:33.082 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:32 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:08:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:08:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:08:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:08:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:08:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:08:33.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:08:33.146 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:32 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:08:33.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:08:33.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:08:33.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:08:33.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:08:33.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:08:33.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:08:33.157 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:32 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:08:33.727 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:33.854 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/2852705647 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d70113170 msgr2=0x7f2d70173b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/2852705647 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d70113170 0x7f2d70173b10 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=1530977262482580073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6c00aa70 tx=0x7f2d6c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/2852705647 shutdown_connections 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/2852705647 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d70113170 0x7f2d70173b10 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=1530977262482580073 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/2852705647 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d7010d950 0x7f2d70112990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/2852705647 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d7010cf60 0x7f2d7010d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:33.970 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/2852705647 >> 10.20.193.90:0/2852705647 conn(0x7f2d700ea840 msgr2=0x7f2d7010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/2852705647 shutdown_connections 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.966+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/2852705647 wait complete. 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 Processor -- start 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 -- start start 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d7010cf60 0x7f2d700f4b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d70113170 0x7f2d70173a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 0x7f2d700fa420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d700f5840 con 0x7f2d700f5150 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d700fa960 con 0x7f2d70113170 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d700fab20 con 0x7f2d7010cf60 2026-02-19T21:08:33.971 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 0x7f2d700fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 0x7f2d700fa420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41352/0 (socket says 10.20.193.90:41352) 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 -- 10.20.193.90:0/3235408400 learned_addr learned my addr 10.20.193.90:0/3235408400 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d755df6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d70113170 0x7f2d70173a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 -- 10.20.193.90:0/3235408400 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d7010cf60 msgr2=0x7f2d700f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d7010cf60 0x7f2d700f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 -- 10.20.193.90:0/3235408400 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d70113170 msgr2=0x7f2d70173a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d70113170 0x7f2d70173a10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 -- 10.20.193.90:0/3235408400 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c00a660 con 0x7f2d700f5150 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d765e16c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 0x7f2d700fa420 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6c0054b0 tx=0x7f2d6c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d6c003a30 con 0x7f2d700f5150 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f2d6c003b90 con 0x7f2d700f5150 2026-02-19T21:08:33.972 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d700fada0 con 0x7f2d700f5150 2026-02-19T21:08:33.973 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d6c0382f0 con 0x7f2d700f5150 2026-02-19T21:08:33.973 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.967+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d700fb220 con 0x7f2d700f5150 2026-02-19T21:08:33.973 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.968+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d7010e230 con 0x7f2d700f5150 2026-02-19T21:08:33.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.970+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f2d6c008260 con 0x7f2d700f5150 2026-02-19T21:08:33.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.970+0000 7f2d5effd6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d4c0b56d0 0x7f2d4c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:33.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.970+0000 7f2d75de06c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d4c0b56d0 0x7f2d4c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:33.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.970+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f2d6c108e30 con 0x7f2d700f5150 2026-02-19T21:08:33.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.970+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2d6c0ce9d0 con 0x7f2d700f5150 2026-02-19T21:08:33.974 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:33.971+0000 7f2d75de06c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d4c0b56d0 0x7f2d4c0d5b80 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d60005980 tx=0x7f2d60005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:34.086 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.084+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2d7010d950 con 0x7f2d700f5150 2026-02-19T21:08:34.086 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:33 trial090 ceph-mon[31759]: pgmap v302: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:34.086 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:33 trial090 ceph-mon[31759]: pgmap v303: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:34.087 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:33 trial090 ceph-mon[31759]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:08:34.087 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:33 trial090 ceph-mon[31759]: Cluster is now healthy 2026-02-19T21:08:34.087 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:33 trial090 ceph-mon[31759]: pgmap v304: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-19T21:08:34.087 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.085+0000 7f2d5effd6c0 1 -- 10.20.193.90:0/3235408400 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2d6c0cebb0 con 0x7f2d700f5150 2026-02-19T21:08:34.088 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:34.088 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:34.088 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.085+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d4c0b56d0 msgr2=0x7f2d4c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:34.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d4c0b56d0 0x7f2d4c0d5b80 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d60005980 tx=0x7f2d60005910 comp rx=0 tx=0).stop 2026-02-19T21:08:34.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 msgr2=0x7f2d700fa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:34.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 0x7f2d700fa420 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6c0054b0 tx=0x7f2d6c0054e0 comp rx=0 tx=0).stop 2026-02-19T21:08:34.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 shutdown_connections 2026-02-19T21:08:34.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f2d4c0b56d0 0x7f2d4c0d5b80 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:34.089 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f2d700f5150 0x7f2d700fa420 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:34.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f2d70113170 0x7f2d70173a10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:34.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 --2- 10.20.193.90:0/3235408400 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f2d7010cf60 0x7f2d700f4b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:34.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 >> 10.20.193.90:0/3235408400 conn(0x7f2d700ea840 msgr2=0x7f2d7010b400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:34.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 shutdown_connections 2026-02-19T21:08:34.090 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:34.086+0000 7f2d7806f6c0 1 -- 10.20.193.90:0/3235408400 wait complete. 2026-02-19T21:08:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:33 trial105 ceph-mon[33883]: pgmap v302: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:33 trial105 ceph-mon[33883]: pgmap v303: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:33 trial105 ceph-mon[33883]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:08:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:33 trial105 ceph-mon[33883]: Cluster is now healthy 2026-02-19T21:08:34.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:33 trial105 ceph-mon[33883]: pgmap v304: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-19T21:08:34.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:33 trial175 ceph-mon[34116]: pgmap v302: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:34.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:33 trial175 ceph-mon[34116]: pgmap v303: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:34.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:33 trial175 ceph-mon[34116]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-19T21:08:34.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:33 trial175 ceph-mon[34116]: Cluster is now healthy 2026-02-19T21:08:34.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:33 trial175 ceph-mon[34116]: pgmap v304: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-19T21:08:35.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:34 trial105 ceph-mon[33883]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:08:35.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:34 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3235408400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:35.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:34 trial090 ceph-mon[31759]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:08:35.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:34 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3235408400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:35.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:34 trial175 ceph-mon[34116]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:08:35.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:34 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3235408400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:36.145 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:35 trial105 ceph-mon[33883]: pgmap v305: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:36.156 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:35 trial090 ceph-mon[31759]: pgmap v305: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:36.266 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:35 trial175 ceph-mon[34116]: pgmap v305: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:37.126 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:37.255 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- 10.20.193.90:0/3584169241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 msgr2=0x7f185c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3584169241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c175db0 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=16840479304398769637 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185800aa70 tx=0x7f185802fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- 10.20.193.90:0/3584169241 shutdown_connections 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3584169241 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c175db0 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=16840479304398769637 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3584169241 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f185c10fbf0 0x7f185c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3584169241 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f185c10f200 0x7f185c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.379 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- 10.20.193.90:0/3584169241 >> 10.20.193.90:0/3584169241 conn(0x7f185c0ecac0 msgr2=0x7f185c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- 10.20.193.90:0/3584169241 shutdown_connections 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- 10.20.193.90:0/3584169241 wait complete. 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 Processor -- start 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- start start 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f185c10f200 0x7f185c11d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c11d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f185c122b20 0x7f185c122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f185c123530 con 0x7f185c115410 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f185c1236a0 con 0x7f185c10f200 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f185c123860 con 0x7f185c122b20 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c11d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:37.380 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c11d760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41366/0 (socket says 10.20.193.90:41366) 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 -- 10.20.193.90:0/3051500320 learned_addr learned my addr 10.20.193.90:0/3051500320 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 -- 10.20.193.90:0/3051500320 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f185c122b20 msgr2=0x7f185c122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f185c122b20 0x7f185c122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 -- 10.20.193.90:0/3051500320 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f185c10f200 msgr2=0x7f185c11d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f185c10f200 0x7f185c11d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 -- 10.20.193.90:0/3051500320 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185800a660 con 0x7f185c115410 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f18613546c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c11d760 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850005dc0 tx=0x7f185000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1850004250 con 0x7f185c115410 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f1850009070 con 0x7f185c115410 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.376+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185c163d10 con 0x7f185c115410 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.377+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f185000cd50 con 0x7f185c115410 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.377+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185c1641f0 con 0x7f185c115410 2026-02-19T21:08:37.381 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.377+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f185c1104d0 con 0x7f185c115410 2026-02-19T21:08:37.382 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.378+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f18500028c0 con 0x7f185c115410 2026-02-19T21:08:37.383 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.379+0000 7f184affd6c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f18380b56d0 0x7f18380d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:37.383 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.379+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f18500e3bd0 con 0x7f185c115410 2026-02-19T21:08:37.383 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.379+0000 7f1861b556c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f18380b56d0 0x7f18380d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:37.383 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.379+0000 7f1861b556c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f18380b56d0 0x7f18380d5b80 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c005980 tx=0x7f184c005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:37.383 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.379+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18500a6580 con 0x7f185c115410 2026-02-19T21:08:37.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.494+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f185c10f5d0 con 0x7f185c115410 2026-02-19T21:08:37.495 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.494+0000 7f184affd6c0 1 -- 10.20.193.90:0/3051500320 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f18500a9730 con 0x7f185c115410 2026-02-19T21:08:37.496 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:37.496 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f18380b56d0 msgr2=0x7f18380d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f18380b56d0 0x7f18380d5b80 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f184c005980 tx=0x7f184c005910 comp rx=0 tx=0).stop 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 msgr2=0x7f185c11d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c11d760 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850005dc0 tx=0x7f185000bbb0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 shutdown_connections 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f18380b56d0 0x7f18380d5b80 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.497 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f185c122b20 0x7f185c122fc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.498 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f185c115410 0x7f185c11d760 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.498 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 --2- 10.20.193.90:0/3051500320 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f185c10f200 0x7f185c11d220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:37.498 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 >> 10.20.193.90:0/3051500320 conn(0x7f185c0ecac0 msgr2=0x7f185c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:37.498 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 shutdown_connections 2026-02-19T21:08:37.498 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:37.495+0000 7f1863de06c0 1 -- 10.20.193.90:0/3051500320 wait complete. 2026-02-19T21:08:38.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:38 trial105 ceph-mon[33883]: pgmap v306: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-19T21:08:38.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:38 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3051500320' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:38.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:38 trial090 ceph-mon[31759]: pgmap v306: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-19T21:08:38.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:38 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3051500320' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:38.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:38 trial175 ceph-mon[34116]: pgmap v306: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.3 KiB/s rd, 5 op/s 2026-02-19T21:08:38.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:38 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3051500320' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:40.536 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:40.562 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:40 trial090 ceph-mon[31759]: pgmap v307: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:40.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:40 trial105 ceph-mon[33883]: pgmap v307: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:40.664 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:40.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:40 trial175 ceph-mon[34116]: pgmap v307: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:40.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/3856032633 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 msgr2=0x7ffb28175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:40.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/3856032633 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb28175db0 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=8824262487871126890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb2400aa70 tx=0x7ffb2402fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/3856032633 shutdown_connections 2026-02-19T21:08:40.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/3856032633 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb28175db0 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=8824262487871126890 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/3856032633 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ffb2810fbf0 0x7ffb28114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.778 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/3856032633 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ffb2810f200 0x7ffb2810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/3856032633 >> 10.20.193.90:0/3856032633 conn(0x7ffb280ecac0 msgr2=0x7ffb2810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/3856032633 shutdown_connections 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.774+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/3856032633 wait complete. 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 Processor -- start 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 -- start start 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ffb2810f200 0x7ffb2811d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb2811d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ffb28122b20 0x7ffb28122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28123530 con 0x7ffb28115410 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281236a0 con 0x7ffb2810f200 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28123860 con 0x7ffb28122b20 2026-02-19T21:08:40.779 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb2811d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb2811d760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:41388/0 (socket says 10.20.193.90:41388) 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 -- 10.20.193.90:0/1591003571 learned_addr learned my addr 10.20.193.90:0/1591003571 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2e0796c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ffb28122b20 0x7ffb28122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d8786c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ffb2810f200 0x7ffb2811d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 -- 10.20.193.90:0/1591003571 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ffb28122b20 msgr2=0x7ffb28122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ffb28122b20 0x7ffb28122fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 -- 10.20.193.90:0/1591003571 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ffb2810f200 msgr2=0x7ffb2811d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ffb2810f200 0x7ffb2811d220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 -- 10.20.193.90:0/1591003571 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2400a660 con 0x7ffb28115410 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2d0776c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb2811d760 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb1c005dc0 tx=0x7ffb1c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb1c004250 con 0x7ffb28115410 2026-02-19T21:08:40.780 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ffb1c009070 con 0x7ffb28115410 2026-02-19T21:08:40.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffb1c00cd50 con 0x7ffb28115410 2026-02-19T21:08:40.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb28163d10 con 0x7ffb28115410 2026-02-19T21:08:40.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.775+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281641a0 con 0x7ffb28115410 2026-02-19T21:08:40.781 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.776+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb281104d0 con 0x7ffb28115410 2026-02-19T21:08:40.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.777+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7ffb1c0028c0 con 0x7ffb28115410 2026-02-19T21:08:40.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.777+0000 7ffb16ffd6c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ffb040b56d0 0x7ffb040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:40.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.778+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ffb1c0e3bc0 con 0x7ffb28115410 2026-02-19T21:08:40.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.778+0000 7ffb2d8786c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ffb040b56d0 0x7ffb040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:40.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.778+0000 7ffb2d8786c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ffb040b56d0 0x7ffb040d5b80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb18005980 tx=0x7ffb18005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:40.782 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.778+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffb1c0a6570 con 0x7ffb28115410 2026-02-19T21:08:40.895 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.893+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffb2810fbf0 con 0x7ffb28115410 2026-02-19T21:08:40.896 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:40.896 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:40.896 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.894+0000 7ffb16ffd6c0 1 -- 10.20.193.90:0/1591003571 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ffb1c0a9720 con 0x7ffb28115410 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ffb040b56d0 msgr2=0x7ffb040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ffb040b56d0 0x7ffb040d5b80 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb18005980 tx=0x7ffb18005910 comp rx=0 tx=0).stop 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 msgr2=0x7ffb2811d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb2811d760 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb1c005dc0 tx=0x7ffb1c00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 shutdown_connections 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ffb040b56d0 0x7ffb040d5b80 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ffb28122b20 0x7ffb28122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ffb28115410 0x7ffb2811d760 unknown :-1 s=CLOSED pgs=445 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 --2- 10.20.193.90:0/1591003571 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ffb2810f200 0x7ffb2811d220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:40.898 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 >> 10.20.193.90:0/1591003571 conn(0x7ffb280ecac0 msgr2=0x7ffb2810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:40.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 shutdown_connections 2026-02-19T21:08:40.899 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:40.896+0000 7ffb2fb076c0 1 -- 10.20.193.90:0/1591003571 wait complete. 2026-02-19T21:08:41.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:41 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1591003571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:41.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:41 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1591003571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:41.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:41 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1591003571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:42.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:42 trial105 ceph-mon[33883]: pgmap v308: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:42.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:42 trial090 ceph-mon[31759]: pgmap v308: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:42.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:42 trial175 ceph-mon[34116]: pgmap v308: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:08:43.935 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:44.061 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:44.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/3060613399 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74115410 msgr2=0x7fec74175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:44.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/3060613399 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74115410 0x7fec74175db0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=6291484557649437598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec7000aa70 tx=0x7fec7002fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.187 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/3060613399 shutdown_connections 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/3060613399 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74115410 0x7fec74175db0 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=6291484557649437598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/3060613399 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec7410fbf0 0x7fec74114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/3060613399 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec7410f200 0x7fec7410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/3060613399 >> 10.20.193.90:0/3060613399 conn(0x7fec740ecac0 msgr2=0x7fec7410ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/3060613399 shutdown_connections 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/3060613399 wait complete. 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 Processor -- start 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- start start 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec7410f200 0x7fec7411d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec74115410 0x7fec7411d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:44.188 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 0x7fec74122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec74123540 con 0x7fec74122b30 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec741236b0 con 0x7fec7410f200 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7b2dd6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec74123870 con 0x7fec74115410 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 0x7fec74122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 0x7fec74122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:60658/0 (socket says 10.20.193.90:60658) 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 -- 10.20.193.90:0/427381073 learned_addr learned my addr 10.20.193.90:0/427381073 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7884d6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec74115410 0x7fec7411d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 -- 10.20.193.90:0/427381073 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec74115410 msgr2=0x7fec7411d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec74115410 0x7fec7411d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 -- 10.20.193.90:0/427381073 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec7410f200 msgr2=0x7fec7411d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:44.189 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec7410f200 0x7fec7411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.184+0000 7fec7984f6c0 1 -- 10.20.193.90:0/427381073 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7000a660 con 0x7fec74122b30 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec7984f6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 0x7fec74122fd0 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec70006ec0 tx=0x7fec70005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec70003c40 con 0x7fec74122b30 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fec70005780 con 0x7fec74122b30 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec74163cc0 con 0x7fec74122b30 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fec700382f0 con 0x7fec74122b30 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec741640f0 con 0x7fec74122b30 2026-02-19T21:08:44.190 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.185+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec741104d0 con 0x7fec74122b30 2026-02-19T21:08:44.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.186+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fec70008260 con 0x7fec74122b30 2026-02-19T21:08:44.191 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.187+0000 7fec627fc6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec500b5650 0x7fec500d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:44.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.187+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fec70108ff0 con 0x7fec74122b30 2026-02-19T21:08:44.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.187+0000 7fec7904e6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec500b5650 0x7fec500d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:44.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.187+0000 7fec7904e6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec500b5650 0x7fec500d5b00 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec64005980 tx=0x7fec64005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:44.192 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.187+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fec700cb9a0 con 0x7fec74122b30 2026-02-19T21:08:44.306 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.304+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fec7410fbf0 con 0x7fec74122b30 2026-02-19T21:08:44.306 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.304+0000 7fec627fc6c0 1 -- 10.20.193.90:0/427381073 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fec700ceb50 con 0x7fec74122b30 2026-02-19T21:08:44.306 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:44.307 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:44.307 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec500b5650 msgr2=0x7fec500d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec500b5650 0x7fec500d5b00 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec64005980 tx=0x7fec64005910 comp rx=0 tx=0).stop 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 msgr2=0x7fec74122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 0x7fec74122fd0 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fec70006ec0 tx=0x7fec70005520 comp rx=0 tx=0).stop 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 shutdown_connections 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fec500b5650 0x7fec500d5b00 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fec74122b30 0x7fec74122fd0 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fec74115410 0x7fec7411d770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 --2- 10.20.193.90:0/427381073 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fec7410f200 0x7fec7411d230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 >> 10.20.193.90:0/427381073 conn(0x7fec740ecac0 msgr2=0x7fec7410cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:44.308 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 shutdown_connections 2026-02-19T21:08:44.309 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:44.306+0000 7fec7b2dd6c0 1 -- 10.20.193.90:0/427381073 wait complete. 2026-02-19T21:08:44.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:44 trial105 ceph-mon[33883]: pgmap v309: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:44.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:44 trial090 ceph-mon[31759]: pgmap v309: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:44.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:44 trial175 ceph-mon[34116]: pgmap v309: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.9 KiB/s rd, 5 op/s 2026-02-19T21:08:45.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:45 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/427381073' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:45.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:45 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/427381073' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:45.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:45 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/427381073' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:46.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:46 trial105 ceph-mon[33883]: pgmap v310: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:46.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:46 trial090 ceph-mon[31759]: pgmap v310: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:46.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:46 trial175 ceph-mon[34116]: pgmap v310: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:47.344 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:47.469 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 -- 10.20.193.90:0/2812380917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc115410 msgr2=0x7f35fc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 --2- 10.20.193.90:0/2812380917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc115410 0x7f35fc175db0 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=14032614408802578283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35f800a9b0 tx=0x7f35f802fd20 comp rx=0 tx=0).stop 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 -- 10.20.193.90:0/2812380917 shutdown_connections 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 --2- 10.20.193.90:0/2812380917 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc115410 0x7f35fc175db0 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=14032614408802578283 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 --2- 10.20.193.90:0/2812380917 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc10fbf0 0x7f35fc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 --2- 10.20.193.90:0/2812380917 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc10f200 0x7f35fc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.589 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 -- 10.20.193.90:0/2812380917 >> 10.20.193.90:0/2812380917 conn(0x7f35fc0eca60 msgr2=0x7f35fc10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 -- 10.20.193.90:0/2812380917 shutdown_connections 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.586+0000 7f3602c446c0 1 -- 10.20.193.90:0/2812380917 wait complete. 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 Processor -- start 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 -- start start 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 0x7f35fc11d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc115410 0x7f35fc11d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc122b00 0x7f35fc122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc123510 con 0x7f35fc10f200 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc123680 con 0x7f35fc115410 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc123840 con 0x7f35fc122b00 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 0x7f35fc11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:47.590 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 0x7f35fc11d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:60678/0 (socket says 10.20.193.90:60678) 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 -- 10.20.193.90:0/632046087 learned_addr learned my addr 10.20.193.90:0/632046087 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f35f3fff6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc115410 0x7f35fc11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 -- 10.20.193.90:0/632046087 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc122b00 msgr2=0x7f35fc122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36011ba6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc122b00 0x7f35fc122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc122b00 0x7f35fc122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 -- 10.20.193.90:0/632046087 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc115410 msgr2=0x7f35fc11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc115410 0x7f35fc11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 -- 10.20.193.90:0/632046087 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f800a5b0 con 0x7f35fc10f200 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f35f3fff6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc115410 0x7f35fc11d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36011ba6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc122b00 0x7f35fc122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f36009b96c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 0x7f35fc11d200 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35ec005950 tx=0x7f35ec00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:47.591 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35ec004460 con 0x7f35fc10f200 2026-02-19T21:08:47.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f35ec0045c0 con 0x7f35fc10f200 2026-02-19T21:08:47.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f35ec003960 con 0x7f35fc10f200 2026-02-19T21:08:47.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.587+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc163cf0 con 0x7f35fc10f200 2026-02-19T21:08:47.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.588+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc164180 con 0x7f35fc10f200 2026-02-19T21:08:47.592 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.588+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35fc1104d0 con 0x7f35fc10f200 2026-02-19T21:08:47.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.589+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f35ec003af0 con 0x7f35fc10f200 2026-02-19T21:08:47.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.590+0000 7f35f1ffb6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35d80b56d0 0x7f35d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:47.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.590+0000 7f35f3fff6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35d80b56d0 0x7f35d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:47.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.590+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f35ec0e3c40 con 0x7f35fc10f200 2026-02-19T21:08:47.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.590+0000 7f35f3fff6c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35d80b56d0 0x7f35d80d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35fc123b90 tx=0x7f35e4009260 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:47.593 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.590+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f35ec0a65f0 con 0x7f35fc10f200 2026-02-19T21:08:47.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.706+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f35fc10f5d0 con 0x7f35fc10f200 2026-02-19T21:08:47.707 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.706+0000 7f35f1ffb6c0 1 -- 10.20.193.90:0/632046087 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f35ec005790 con 0x7f35fc10f200 2026-02-19T21:08:47.707 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:47.708 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35d80b56d0 msgr2=0x7f35d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35d80b56d0 0x7f35d80d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35fc123b90 tx=0x7f35e4009260 comp rx=0 tx=0).stop 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 msgr2=0x7f35fc11d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 0x7f35fc11d200 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35ec005950 tx=0x7f35ec00bca0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 shutdown_connections 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f35d80b56d0 0x7f35d80d5b80 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f35fc122b00 0x7f35fc122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f35fc115410 0x7f35fc11d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.709 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 --2- 10.20.193.90:0/632046087 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f35fc10f200 0x7f35fc11d200 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:47.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 >> 10.20.193.90:0/632046087 conn(0x7f35fc0eca60 msgr2=0x7f35fc10ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:47.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 shutdown_connections 2026-02-19T21:08:47.710 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:47.708+0000 7f3602c446c0 1 -- 10.20.193.90:0/632046087 wait complete. 2026-02-19T21:08:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:48 trial105 ceph-mon[33883]: pgmap v311: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:48.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:48 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/632046087' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:48.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:48 trial090 ceph-mon[31759]: pgmap v311: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:48.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:48 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/632046087' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:48.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:48 trial175 ceph-mon[34116]: pgmap v311: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:48.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:48 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/632046087' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:50.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:50 trial105 ceph-mon[33883]: pgmap v312: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:50.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:50 trial090 ceph-mon[31759]: pgmap v312: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:50.748 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:50.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:50 trial175 ceph-mon[34116]: pgmap v312: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:50.874 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/3353325735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff784115410 msgr2=0x7ff784175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/3353325735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff784115410 0x7ff784175db0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=352301394294561066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff78000aa70 tx=0x7ff78002fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/3353325735 shutdown_connections 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/3353325735 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff784115410 0x7ff784175db0 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=352301394294561066 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/3353325735 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff78410fbf0 0x7ff784114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/3353325735 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff78410f200 0x7ff78410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/3353325735 >> 10.20.193.90:0/3353325735 conn(0x7ff7840eca60 msgr2=0x7ff78410ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/3353325735 shutdown_connections 2026-02-19T21:08:50.998 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/3353325735 wait complete. 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 Processor -- start 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.995+0000 7ff78bf9c6c0 1 -- start start 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 0x7ff78411d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff784115410 0x7ff78411d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff784122b20 0x7ff784122fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff784123530 con 0x7ff78410f200 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7841236a0 con 0x7ff784122b20 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff784123860 con 0x7ff784115410 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 0x7ff78411d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 0x7ff78411d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:60700/0 (socket says 10.20.193.90:60700) 2026-02-19T21:08:50.999 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 -- 10.20.193.90:0/2904058768 learned_addr learned my addr 10.20.193.90:0/2904058768 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78a5126c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff784122b20 0x7ff784122fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 -- 10.20.193.90:0/2904058768 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff784115410 msgr2=0x7ff78411d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff784115410 0x7ff78411d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 -- 10.20.193.90:0/2904058768 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff784122b20 msgr2=0x7ff784122fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff784122b20 0x7ff784122fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 -- 10.20.193.90:0/2904058768 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78000a660 con 0x7ff78410f200 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff789d116c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 0x7ff78411d220 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff77400b710 tx=0x7ff77400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff774004250 con 0x7ff78410f200 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff784163d10 con 0x7ff78410f200 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff774002d80 con 0x7ff78410f200 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff77400cdc0 con 0x7ff78410f200 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7841641a0 con 0x7ff78410f200 2026-02-19T21:08:51.000 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.996+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7841104d0 con 0x7ff78410f200 2026-02-19T21:08:51.001 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.998+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7ff7740028c0 con 0x7ff78410f200 2026-02-19T21:08:51.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.998+0000 7ff772ffd6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7600b5650 0x7ff7600d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:51.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.999+0000 7ff7895106c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7600b5650 0x7ff7600d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:51.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.999+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ff7740e3d60 con 0x7ff78410f200 2026-02-19T21:08:51.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.999+0000 7ff7895106c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7600b5650 0x7ff7600d5b00 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff778005980 tx=0x7ff778005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:51.002 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:50.999+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff7740a6710 con 0x7ff78410f200 2026-02-19T21:08:51.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.114+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff78410fbf0 con 0x7ff78410f200 2026-02-19T21:08:51.115 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.115+0000 7ff772ffd6c0 1 -- 10.20.193.90:0/2904058768 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff7740a98c0 con 0x7ff78410f200 2026-02-19T21:08:51.115 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:51.115 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:51.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7600b5650 msgr2=0x7ff7600d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:51.116 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7600b5650 0x7ff7600d5b00 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff778005980 tx=0x7ff778005910 comp rx=0 tx=0).stop 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 msgr2=0x7ff78411d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 0x7ff78411d220 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff77400b710 tx=0x7ff77400bbe0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 shutdown_connections 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff7600b5650 0x7ff7600d5b00 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff784122b20 0x7ff784122fc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff784115410 0x7ff78411d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 --2- 10.20.193.90:0/2904058768 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff78410f200 0x7ff78411d220 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 >> 10.20.193.90:0/2904058768 conn(0x7ff7840eca60 msgr2=0x7ff78410ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 shutdown_connections 2026-02-19T21:08:51.117 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:51.116+0000 7ff78bf9c6c0 1 -- 10.20.193.90:0/2904058768 wait complete. 2026-02-19T21:08:51.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:51 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2904058768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:51.546 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:51 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2904058768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:51.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:51 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2904058768' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:52.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:52 trial105 ceph-mon[33883]: pgmap v313: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:52.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:52 trial090 ceph-mon[31759]: pgmap v313: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:52.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:52 trial175 ceph-mon[34116]: pgmap v313: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:08:54.156 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:54.283 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:54.404 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.400+0000 7f8140f486c0 1 -- 10.20.193.90:0/84177627 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 msgr2=0x7f813c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:54.404 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.400+0000 7f8140f486c0 1 --2- 10.20.193.90:0/84177627 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c10f5d0 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=12271003347982799241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81300099a0 tx=0x7f813002ed20 comp rx=0 tx=0).stop 2026-02-19T21:08:54.404 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.400+0000 7f8140f486c0 1 -- 10.20.193.90:0/84177627 shutdown_connections 2026-02-19T21:08:54.404 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.400+0000 7f8140f486c0 1 --2- 10.20.193.90:0/84177627 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 0x7f813c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 --2- 10.20.193.90:0/84177627 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f813c10fbf0 0x7f813c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 --2- 10.20.193.90:0/84177627 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c10f5d0 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=12271003347982799241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- 10.20.193.90:0/84177627 >> 10.20.193.90:0/84177627 conn(0x7f813c0ecac0 msgr2=0x7f813c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- 10.20.193.90:0/84177627 shutdown_connections 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- 10.20.193.90:0/84177627 wait complete. 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 Processor -- start 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- start start 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c11d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 0x7f813c11d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f813c122b60 0x7f813c123000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f813c123540 con 0x7f813c10f200 2026-02-19T21:08:54.405 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f813c1236b0 con 0x7f813c115410 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f813c123870 con 0x7f813c122b60 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c11d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c11d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:59796/0 (socket says 10.20.193.90:59796) 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 -- 10.20.193.90:0/366146895 learned_addr learned my addr 10.20.193.90:0/366146895 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8139d746c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 0x7f813c11d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 -- 10.20.193.90:0/366146895 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f813c122b60 msgr2=0x7f813c123000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f813c122b60 0x7f813c123000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 -- 10.20.193.90:0/366146895 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 msgr2=0x7f813c11d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 0x7f813c11d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 -- 10.20.193.90:0/366146895 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8130009590 con 0x7f813c10f200 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8139d746c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 0x7f813c11d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:54.406 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f813a5756c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c11d260 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f813002f230 tx=0x7f813002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:54.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8130002ba0 con 0x7f813c10f200 2026-02-19T21:08:54.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8130002d00 con 0x7f813c10f200 2026-02-19T21:08:54.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c163cf0 con 0x7f813c10f200 2026-02-19T21:08:54.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f81300372f0 con 0x7f813c10f200 2026-02-19T21:08:54.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.401+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c1641c0 con 0x7f813c10f200 2026-02-19T21:08:54.407 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.402+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c1104d0 con 0x7f813c10f200 2026-02-19T21:08:54.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.403+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f81300078d0 con 0x7f813c10f200 2026-02-19T21:08:54.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.404+0000 7f81237fe6c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f81140b56d0 0x7f81140d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:54.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.404+0000 7f8139d746c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f81140b56d0 0x7f81140d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:54.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.404+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f8130107cf0 con 0x7f813c10f200 2026-02-19T21:08:54.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.404+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f81300ce100 con 0x7f813c10f200 2026-02-19T21:08:54.408 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.404+0000 7f8139d746c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f81140b56d0 0x7f81140d5b80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f813c123bf0 tx=0x7f8124005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:54.519 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.518+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f813c10f5d0 con 0x7f813c10f200 2026-02-19T21:08:54.519 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:54 trial090 ceph-mon[31759]: pgmap v314: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:54.520 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.518+0000 7f81237fe6c0 1 -- 10.20.193.90:0/366146895 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f81300cd850 con 0x7f813c10f200 2026-02-19T21:08:54.520 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:54.520 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:54.521 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f81140b56d0 msgr2=0x7f81140d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:54.521 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f81140b56d0 0x7f81140d5b80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f813c123bf0 tx=0x7f8124005f10 comp rx=0 tx=0).stop 2026-02-19T21:08:54.521 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 msgr2=0x7f813c11d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:54.521 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c11d260 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f813002f230 tx=0x7f813002fd40 comp rx=0 tx=0).stop 2026-02-19T21:08:54.521 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 shutdown_connections 2026-02-19T21:08:54.521 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f81140b56d0 0x7f81140d5b80 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.522 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f813c122b60 0x7f813c123000 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.522 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f813c115410 0x7f813c11d7a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.522 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 --2- 10.20.193.90:0/366146895 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f813c10f200 0x7f813c11d260 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:54.522 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 >> 10.20.193.90:0/366146895 conn(0x7f813c0ecac0 msgr2=0x7f813c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:54.522 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 shutdown_connections 2026-02-19T21:08:54.522 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:54.519+0000 7f8140f486c0 1 -- 10.20.193.90:0/366146895 wait complete. 2026-02-19T21:08:54.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:54 trial105 ceph-mon[33883]: pgmap v314: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:54.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:54 trial175 ceph-mon[34116]: pgmap v314: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:55.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:55 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/366146895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:55.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:55 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/366146895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:55.667 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:55 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/366146895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:56.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:56 trial105 ceph-mon[33883]: pgmap v315: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:56.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:56 trial090 ceph-mon[31759]: pgmap v315: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:56.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:56 trial175 ceph-mon[34116]: pgmap v315: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:08:57.560 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:08:57.688 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 -- 10.20.193.90:0/1552367774 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc581556a0 msgr2=0x7fdc58175a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1552367774 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc581556a0 0x7fdc58175a80 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=11793859162345889446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc5400aa40 tx=0x7fdc5402fde0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 -- 10.20.193.90:0/1552367774 shutdown_connections 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1552367774 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc581556a0 0x7fdc58175a80 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=11793859162345889446 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1552367774 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc58060ff0 0x7fdc58155160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1552367774 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 0x7fdc58060ab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 -- 10.20.193.90:0/1552367774 >> 10.20.193.90:0/1552367774 conn(0x7fdc580ea870 msgr2=0x7fdc5810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 -- 10.20.193.90:0/1552367774 shutdown_connections 2026-02-19T21:08:57.810 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.806+0000 7fdc607036c0 1 -- 10.20.193.90:0/1552367774 wait complete. 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 Processor -- start 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 -- start start 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 0x7fdc581614c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 0x7fdc58161a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc581556a0 0x7fdc58166dc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58167410 con 0x7fdc58060ff0 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58167580 con 0x7fdc581556a0 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58167740 con 0x7fdc580606e0 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 0x7fdc58161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 0x7fdc58161a00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:59818/0 (socket says 10.20.193.90:59818) 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 -- 10.20.193.90:0/1560786792 learned_addr learned my addr 10.20.193.90:0/1560786792 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:08:57.811 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5e4746c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 0x7fdc581614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5ec756c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc581556a0 0x7fdc58166dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 -- 10.20.193.90:0/1560786792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 msgr2=0x7fdc581614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 0x7fdc581614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 -- 10.20.193.90:0/1560786792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc581556a0 msgr2=0x7fdc58166dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc581556a0 0x7fdc58166dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 -- 10.20.193.90:0/1560786792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5400a660 con 0x7fdc58060ff0 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5e4746c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 0x7fdc581614c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5ec756c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc581556a0 0x7fdc58166dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc5dc736c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 0x7fdc58161a00 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc4c005dc0 tx=0x7fdc4c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc4c004250 con 0x7fdc58060ff0 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fdc4c009070 con 0x7fdc58060ff0 2026-02-19T21:08:57.812 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc58167a20 con 0x7fdc58060ff0 2026-02-19T21:08:57.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc4c00cd70 con 0x7fdc58060ff0 2026-02-19T21:08:57.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.807+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc581512d0 con 0x7fdc58060ff0 2026-02-19T21:08:57.813 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.808+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc58061bf0 con 0x7fdc58060ff0 2026-02-19T21:08:57.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.809+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fdc4c0028c0 con 0x7fdc58060ff0 2026-02-19T21:08:57.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.810+0000 7fdc3f7fe6c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdc340b5650 0x7fdc340d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:08:57.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.810+0000 7fdc5e4746c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdc340b5650 0x7fdc340d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:08:57.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.810+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fdc4c0e3b80 con 0x7fdc58060ff0 2026-02-19T21:08:57.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.810+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdc4c0a9540 con 0x7fdc58060ff0 2026-02-19T21:08:57.814 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.810+0000 7fdc5e4746c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdc340b5650 0x7fdc340d5b00 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc48004750 tx=0x7fdc48005f10 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:08:57.925 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.924+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc58060ab0 con 0x7fdc58060ff0 2026-02-19T21:08:57.926 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.924+0000 7fdc3f7fe6c0 1 -- 10.20.193.90:0/1560786792 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdc4c0a9720 con 0x7fdc58060ff0 2026-02-19T21:08:57.926 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:08:57.926 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:08:57.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdc340b5650 msgr2=0x7fdc340d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:57.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdc340b5650 0x7fdc340d5b00 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc48004750 tx=0x7fdc48005f10 comp rx=0 tx=0).stop 2026-02-19T21:08:57.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 msgr2=0x7fdc58161a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:08:57.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 0x7fdc58161a00 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc4c005dc0 tx=0x7fdc4c00bbb0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 shutdown_connections 2026-02-19T21:08:57.927 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fdc340b5650 0x7fdc340d5b00 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fdc581556a0 0x7fdc58166dc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fdc58060ff0 0x7fdc58161a00 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 --2- 10.20.193.90:0/1560786792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fdc580606e0 0x7fdc581614c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:08:57.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 >> 10.20.193.90:0/1560786792 conn(0x7fdc580ea870 msgr2=0x7fdc5810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:08:57.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 shutdown_connections 2026-02-19T21:08:57.928 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:08:57.925+0000 7fdc607036c0 1 -- 10.20.193.90:0/1560786792 wait complete. 2026-02-19T21:08:58.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:58 trial105 ceph-mon[33883]: pgmap v316: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:58.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:08:58 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1560786792' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:58.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:58 trial090 ceph-mon[31759]: pgmap v316: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:58.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:08:58 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1560786792' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:08:58.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:58 trial175 ceph-mon[34116]: pgmap v316: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:08:58.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:08:58 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1560786792' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:00.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:00 trial105 ceph-mon[33883]: pgmap v317: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:00.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:00 trial090 ceph-mon[31759]: pgmap v317: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:00.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:00 trial175 ceph-mon[34116]: pgmap v317: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:00.966 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:01.091 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:01.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 -- 10.20.193.90:0/1962372609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e010fbf0 msgr2=0x7f26e0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:01.216 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/1962372609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e010fbf0 0x7f26e0114c30 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=6971058428174857511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c80099a0 tx=0x7f26c802ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 -- 10.20.193.90:0/1962372609 shutdown_connections 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/1962372609 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f26e0115410 0x7f26e0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/1962372609 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e010fbf0 0x7f26e0114c30 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=6971058428174857511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/1962372609 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 0x7f26e010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 -- 10.20.193.90:0/1962372609 >> 10.20.193.90:0/1962372609 conn(0x7f26e00eca60 msgr2=0x7f26e010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 -- 10.20.193.90:0/1962372609 shutdown_connections 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.212+0000 7f26e718f6c0 1 -- 10.20.193.90:0/1962372609 wait complete. 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 Processor -- start 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 -- start start 2026-02-19T21:09:01.217 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 0x7f26e00f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 0x7f26e0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f26e00f5240 0x7f26e00fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26e00f5930 con 0x7f26e0115410 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f26e00faa50 con 0x7f26e00f5240 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f26e00fac10 con 0x7f26e010f200 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 0x7f26e0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 0x7f26e0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:59838/0 (socket says 10.20.193.90:59838) 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 -- 10.20.193.90:0/4153447569 learned_addr learned my addr 10.20.193.90:0/4153447569 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e4f006c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 0x7f26e00f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 -- 10.20.193.90:0/4153447569 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 msgr2=0x7f26e00f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 0x7f26e00f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.218 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 -- 10.20.193.90:0/4153447569 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f26e00f5240 msgr2=0x7f26e00fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f26e00f5240 0x7f26e00fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 -- 10.20.193.90:0/4153447569 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c8009590 con 0x7f26e0115410 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e4f006c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 0x7f26e00f4c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d7fff6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 0x7f26e0175cb0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c80023c0 tx=0x7f26c802fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c8002ae0 con 0x7f26e0115410 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f26c8002c40 con 0x7f26e0115410 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e00fae90 con 0x7f26e0115410 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26c80372f0 con 0x7f26e0115410 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.213+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e00fb360 con 0x7f26e0115410 2026-02-19T21:09:01.219 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.214+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e01104d0 con 0x7f26e0115410 2026-02-19T21:09:01.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.215+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f26c8007810 con 0x7f26e0115410 2026-02-19T21:09:01.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.216+0000 7f26d5ffb6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26bc0b56d0 0x7f26bc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:01.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.216+0000 7f26e4f006c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26bc0b56d0 0x7f26bc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:01.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.216+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f26c8107d00 con 0x7f26e0115410 2026-02-19T21:09:01.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.216+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26c80ccc00 con 0x7f26e0115410 2026-02-19T21:09:01.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.216+0000 7f26e4f006c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26bc0b56d0 0x7f26bc0d5b80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26d0004750 tx=0x7f26d0006e70 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:01.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.332+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26e010f5d0 con 0x7f26e0115410 2026-02-19T21:09:01.333 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.332+0000 7f26d5ffb6c0 1 -- 10.20.193.90:0/4153447569 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f26c80cd350 con 0x7f26e0115410 2026-02-19T21:09:01.334 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:01.334 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:01.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26bc0b56d0 msgr2=0x7f26bc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:01.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26bc0b56d0 0x7f26bc0d5b80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26d0004750 tx=0x7f26d0006e70 comp rx=0 tx=0).stop 2026-02-19T21:09:01.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 msgr2=0x7f26e0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:01.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 0x7f26e0175cb0 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26c80023c0 tx=0x7f26c802fbf0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.335 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 shutdown_connections 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f26bc0b56d0 0x7f26bc0d5b80 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f26e00f5240 0x7f26e00fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f26e0115410 0x7f26e0175cb0 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 --2- 10.20.193.90:0/4153447569 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f26e010f200 0x7f26e00f4c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 >> 10.20.193.90:0/4153447569 conn(0x7f26e00eca60 msgr2=0x7f26e010d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 shutdown_connections 2026-02-19T21:09:01.336 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:01.333+0000 7f26e718f6c0 1 -- 10.20.193.90:0/4153447569 wait complete. 2026-02-19T21:09:02.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:02 trial105 ceph-mon[33883]: pgmap v318: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:02.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:02 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4153447569' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:02.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:02 trial090 ceph-mon[31759]: pgmap v318: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:02.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:02 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4153447569' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:02.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:02 trial175 ceph-mon[34116]: pgmap v318: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:02.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:02 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4153447569' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:04.374 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:04.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:04 trial105 ceph-mon[33883]: pgmap v319: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:04.499 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:04.553 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:04 trial090 ceph-mon[31759]: pgmap v319: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:04.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 -- 10.20.193.90:0/2136300540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010fbf0 msgr2=0x7ff200114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:04.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 --2- 10.20.193.90:0/2136300540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010fbf0 0x7ff200114c30 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=3346139942949454091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f00098d0 tx=0x7ff1f002ec40 comp rx=0 tx=0).stop 2026-02-19T21:09:04.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 -- 10.20.193.90:0/2136300540 shutdown_connections 2026-02-19T21:09:04.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 --2- 10.20.193.90:0/2136300540 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 0x7ff200175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 --2- 10.20.193.90:0/2136300540 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010fbf0 0x7ff200114c30 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=3346139942949454091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 --2- 10.20.193.90:0/2136300540 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff20010f200 0x7ff20010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 -- 10.20.193.90:0/2136300540 >> 10.20.193.90:0/2136300540 conn(0x7ff2000eca60 msgr2=0x7ff20010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:04.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 -- 10.20.193.90:0/2136300540 shutdown_connections 2026-02-19T21:09:04.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 -- 10.20.193.90:0/2136300540 wait complete. 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 Processor -- start 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.611+0000 7ff205c046c0 1 -- start start 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 0x7ff2000f4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 0x7ff200175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff2000f5240 0x7ff2000fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000f5930 con 0x7ff20010f200 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000faa50 con 0x7ff200115410 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000fac10 con 0x7ff2000f5240 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 0x7ff2000f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 0x7ff2000f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33780/0 (socket says 10.20.193.90:33780) 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 -- 10.20.193.90:0/3313322914 learned_addr learned my addr 10.20.193.90:0/3313322914 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:04.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1fffff6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff2000f5240 0x7ff2000fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1feffd6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 0x7ff200175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 -- 10.20.193.90:0/3313322914 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff2000f5240 msgr2=0x7ff2000fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff2000f5240 0x7ff2000fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 -- 10.20.193.90:0/3313322914 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 msgr2=0x7ff200175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 0x7ff200175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 -- 10.20.193.90:0/3313322914 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f00094c0 con 0x7ff20010f200 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1fffff6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff2000f5240 0x7ff2000fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1feffd6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 0x7ff200175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1ff7fe6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 0x7ff2000f4c10 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec00b800 tx=0x7ff1ec00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1ec004a80 con 0x7ff20010f200 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2000faef0 con 0x7ff20010f200 2026-02-19T21:09:04.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7ff1ec009030 con 0x7ff20010f200 2026-02-19T21:09:04.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff1ec005710 con 0x7ff20010f200 2026-02-19T21:09:04.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.612+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2000fb680 con 0x7ff20010f200 2026-02-19T21:09:04.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.613+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2001104d0 con 0x7ff20010f200 2026-02-19T21:09:04.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.614+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7ff1ec004060 con 0x7ff20010f200 2026-02-19T21:09:04.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.615+0000 7ff1fcff96c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff1d40b5640 0x7ff1d40d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:04.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.615+0000 7ff1feffd6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff1d40b5640 0x7ff1d40d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:04.620 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.615+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7ff1ec0e3be0 con 0x7ff20010f200 2026-02-19T21:09:04.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.615+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff1ec0e40d0 con 0x7ff20010f200 2026-02-19T21:09:04.621 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.615+0000 7ff1feffd6c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff1d40b5640 0x7ff1d40d5af0 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f00097f0 tx=0x7ff1f00023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:04.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.731+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2000f5d60 con 0x7ff20010f200 2026-02-19T21:09:04.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.731+0000 7ff1fcff96c0 1 -- 10.20.193.90:0/3313322914 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff1ec0a65d0 con 0x7ff20010f200 2026-02-19T21:09:04.733 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:04.733 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:04.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff1d40b5640 msgr2=0x7ff1d40d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:04.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff1d40b5640 0x7ff1d40d5af0 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1f00097f0 tx=0x7ff1f00023a0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 msgr2=0x7ff2000f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 0x7ff2000f4c10 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff1ec00b800 tx=0x7ff1ec00bcd0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 shutdown_connections 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7ff1d40b5640 0x7ff1d40d5af0 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7ff2000f5240 0x7ff2000fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7ff200115410 0x7ff200175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 --2- 10.20.193.90:0/3313322914 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7ff20010f200 0x7ff2000f4c10 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 >> 10.20.193.90:0/3313322914 conn(0x7ff2000eca60 msgr2=0x7ff20010d820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 shutdown_connections 2026-02-19T21:09:04.735 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:04.732+0000 7ff205c046c0 1 -- 10.20.193.90:0/3313322914 wait complete. 2026-02-19T21:09:04.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:04 trial175 ceph-mon[34116]: pgmap v319: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:05.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:05 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3313322914' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:05.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:05 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3313322914' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:05.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:05 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3313322914' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:06.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:06 trial105 ceph-mon[33883]: pgmap v320: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:06.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:06 trial090 ceph-mon[31759]: pgmap v320: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:06.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:06 trial175 ceph-mon[34116]: pgmap v320: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:07.772 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:07.899 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:08.021 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 -- 10.20.193.90:0/1772453616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 msgr2=0x7f0d20173b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/1772453616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d20173b20 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=7468509914971692200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d1400aa70 tx=0x7f0d1402fde0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 -- 10.20.193.90:0/1772453616 shutdown_connections 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/1772453616 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d20173b20 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=7468509914971692200 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/1772453616 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0d2010d960 0x7f0d201129a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/1772453616 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0d2010cf70 0x7f0d2010d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 -- 10.20.193.90:0/1772453616 >> 10.20.193.90:0/1772453616 conn(0x7f0d200ea870 msgr2=0x7f0d2010ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 -- 10.20.193.90:0/1772453616 shutdown_connections 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 -- 10.20.193.90:0/1772453616 wait complete. 2026-02-19T21:09:08.022 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 Processor -- start 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.018+0000 7f0d25af16c0 1 -- start start 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0d2010cf70 0x7f0d20062030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d200605a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0d20060ae0 0x7f0d20060f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20167bb0 con 0x7f0d20113180 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20167d20 con 0x7f0d2010cf70 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20167ee0 con 0x7f0d20060ae0 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d200605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d200605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33798/0 (socket says 10.20.193.90:33798) 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 -- 10.20.193.90:0/2227753333 learned_addr learned my addr 10.20.193.90:0/2227753333 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1f7fe6c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0d2010cf70 0x7f0d20062030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:08.023 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 -- 10.20.193.90:0/2227753333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0d20060ae0 msgr2=0x7f0d20060f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0d20060ae0 0x7f0d20060f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 -- 10.20.193.90:0/2227753333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0d2010cf70 msgr2=0x7f0d20062030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0d2010cf70 0x7f0d20062030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 -- 10.20.193.90:0/2227753333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1400a660 con 0x7f0d20113180 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1effd6c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d200605a0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d1000b6c0 tx=0x7f0d1000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d10004250 con 0x7f0d20113180 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f0d10009070 con 0x7f0d20113180 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d201681c0 con 0x7f0d20113180 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d1000ccb0 con 0x7f0d20113180 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d20168650 con 0x7f0d20113180 2026-02-19T21:09:08.024 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.019+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2010e240 con 0x7f0d20113180 2026-02-19T21:09:08.025 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.021+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f0d100028c0 con 0x7f0d20113180 2026-02-19T21:09:08.026 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.021+0000 7f0d1cff96c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0cf40b5650 0x7f0cf40d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:08.026 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.021+0000 7f0d1f7fe6c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0cf40b5650 0x7f0cf40d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:08.026 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.022+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f0d100e3bc0 con 0x7f0d20113180 2026-02-19T21:09:08.026 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.022+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0d100a6570 con 0x7f0d20113180 2026-02-19T21:09:08.026 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.022+0000 7f0d1f7fe6c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0cf40b5650 0x7f0cf40d5b00 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d0c005980 tx=0x7f0d0c005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:08.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.138+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0d2010d960 con 0x7f0d20113180 2026-02-19T21:09:08.139 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.138+0000 7f0d1cff96c0 1 -- 10.20.193.90:0/2227753333 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0d100a9720 con 0x7f0d20113180 2026-02-19T21:09:08.140 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:08.140 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0cf40b5650 msgr2=0x7f0cf40d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0cf40b5650 0x7f0cf40d5b00 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d0c005980 tx=0x7f0d0c005910 comp rx=0 tx=0).stop 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 msgr2=0x7f0d200605a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d200605a0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d1000b6c0 tx=0x7f0d1000bb90 comp rx=0 tx=0).stop 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 shutdown_connections 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f0cf40b5650 0x7f0cf40d5b00 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.141 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f0d20060ae0 0x7f0d20060f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f0d20113180 0x7f0d200605a0 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 --2- 10.20.193.90:0/2227753333 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f0d2010cf70 0x7f0d20062030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:08.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 >> 10.20.193.90:0/2227753333 conn(0x7f0d200ea870 msgr2=0x7f0d2010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:08.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 shutdown_connections 2026-02-19T21:09:08.142 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:08.139+0000 7f0d25af16c0 1 -- 10.20.193.90:0/2227753333 wait complete. 2026-02-19T21:09:08.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:08 trial090 ceph-mon[31759]: pgmap v321: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:08.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:08 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2227753333' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:08.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:08 trial105 ceph-mon[33883]: pgmap v321: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:08.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:08 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2227753333' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:08.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:08 trial175 ceph-mon[34116]: pgmap v321: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:08.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:08 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2227753333' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:10.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:10 trial105 ceph-mon[33883]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:10.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:10 trial090 ceph-mon[31759]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:10.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:10 trial175 ceph-mon[34116]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:11.180 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:11.305 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- 10.20.193.90:0/2469517889 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c10f200 msgr2=0x7f886c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- 10.20.193.90:0/2469517889 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c10f200 0x7f886c10f5d0 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=977356737388839628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885c0099a0 tx=0x7f885c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- 10.20.193.90:0/2469517889 shutdown_connections 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- 10.20.193.90:0/2469517889 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f886c115410 0x7f886c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- 10.20.193.90:0/2469517889 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f886c10fbf0 0x7f886c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- 10.20.193.90:0/2469517889 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c10f200 0x7f886c10f5d0 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=977356737388839628 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.421 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- 10.20.193.90:0/2469517889 >> 10.20.193.90:0/2469517889 conn(0x7f886c0eca60 msgr2=0x7f886c10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- 10.20.193.90:0/2469517889 shutdown_connections 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- 10.20.193.90:0/2469517889 wait complete. 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 Processor -- start 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- start start 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f886c10f200 0x7f886c11d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 0x7f886c11d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f886c122bf0 0x7f886c123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f886c1235d0 con 0x7f886c115410 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f886c123740 con 0x7f886c10f200 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88747a76c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f886c123900 con 0x7f886c122bf0 2026-02-19T21:09:11.422 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 0x7f886c11d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 0x7f886c11d830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:33816/0 (socket says 10.20.193.90:33816) 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 -- 10.20.193.90:0/7989999 learned_addr learned my addr 10.20.193.90:0/7989999 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f88725186c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f886c10f200 0x7f886c11d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 -- 10.20.193.90:0/7989999 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f886c122bf0 msgr2=0x7f886c123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f886c122bf0 0x7f886c123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 -- 10.20.193.90:0/7989999 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f886c10f200 msgr2=0x7f886c11d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f886c10f200 0x7f886c11d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 -- 10.20.193.90:0/7989999 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c009590 con 0x7f886c115410 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.418+0000 7f8871d176c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 0x7f886c11d830 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f886000b650 tx=0x7f886000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.419+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88600044a0 con 0x7f886c115410 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.419+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886c163d80 con 0x7f886c115410 2026-02-19T21:09:11.423 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.419+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f8860009030 con 0x7f886c115410 2026-02-19T21:09:11.424 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.419+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f886000cc10 con 0x7f886c115410 2026-02-19T21:09:11.424 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.419+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886c1642b0 con 0x7f886c115410 2026-02-19T21:09:11.424 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.419+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f886c1104d0 con 0x7f886c115410 2026-02-19T21:09:11.425 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.421+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f88600026b0 con 0x7f886c115410 2026-02-19T21:09:11.425 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.421+0000 7f88537fe6c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88480b5650 0x7f88480d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:11.425 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.421+0000 7f88725186c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88480b5650 0x7f88480d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:11.425 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.422+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f88600e3b70 con 0x7f886c115410 2026-02-19T21:09:11.425 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.422+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f886011c5e0 con 0x7f886c115410 2026-02-19T21:09:11.425 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.422+0000 7f88725186c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88480b5650 0x7f88480d5b00 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885c0092e0 tx=0x7f885c005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:11.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.537+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f886c11e440 con 0x7f886c115410 2026-02-19T21:09:11.539 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.537+0000 7f88537fe6c0 1 -- 10.20.193.90:0/7989999 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f88600a6520 con 0x7f886c115410 2026-02-19T21:09:11.539 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:11.539 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:11.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88480b5650 msgr2=0x7f88480d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:11.540 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88480b5650 0x7f88480d5b00 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f885c0092e0 tx=0x7f885c005c00 comp rx=0 tx=0).stop 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 msgr2=0x7f886c11d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 0x7f886c11d830 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f886000b650 tx=0x7f886000bb20 comp rx=0 tx=0).stop 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 shutdown_connections 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f88480b5650 0x7f88480d5b00 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f886c122bf0 0x7f886c123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f886c115410 0x7f886c11d830 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 --2- 10.20.193.90:0/7989999 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f886c10f200 0x7f886c11d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 >> 10.20.193.90:0/7989999 conn(0x7f886c0eca60 msgr2=0x7f886c10ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 shutdown_connections 2026-02-19T21:09:11.541 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:11.538+0000 7f88747a76c0 1 -- 10.20.193.90:0/7989999 wait complete. 2026-02-19T21:09:12.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:12 trial105 ceph-mon[33883]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:12.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:12 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/7989999' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:12.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:12 trial090 ceph-mon[31759]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:12.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:12 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/7989999' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:12.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:12 trial175 ceph-mon[34116]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:12.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:12 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/7989999' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:14.579 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:14.606 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:14 trial090 ceph-mon[31759]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:14.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:14 trial105 ceph-mon[33883]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:14.704 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:14.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:14 trial175 ceph-mon[34116]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:14.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- 10.20.193.90:0/3981389216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c10f200 msgr2=0x7f510c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:14.824 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- 10.20.193.90:0/3981389216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c10f200 0x7f510c10f5d0 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=14755324291994872880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50f80099a0 tx=0x7f50f802ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- 10.20.193.90:0/3981389216 shutdown_connections 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- 10.20.193.90:0/3981389216 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f510c115410 0x7f510c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- 10.20.193.90:0/3981389216 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f510c10fbf0 0x7f510c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- 10.20.193.90:0/3981389216 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c10f200 0x7f510c10f5d0 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=14755324291994872880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- 10.20.193.90:0/3981389216 >> 10.20.193.90:0/3981389216 conn(0x7f510c0ecac0 msgr2=0x7f510c10ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- 10.20.193.90:0/3981389216 shutdown_connections 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- 10.20.193.90:0/3981389216 wait complete. 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 Processor -- start 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- start start 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f510c10f200 0x7f510c11d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:14.825 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f510c115410 0x7f510c11d850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 0x7f510c1230b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f510c123620 con 0x7f510c122c10 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f510c123790 con 0x7f510c10f200 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.821+0000 7f51124676c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f510c123950 con 0x7f510c115410 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 0x7f510c1230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 0x7f510c1230b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:55424/0 (socket says 10.20.193.90:55424) 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 -- 10.20.193.90:0/2207295792 learned_addr learned my addr 10.20.193.90:0/2207295792 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f510b7fe6c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f510c115410 0x7f510c11d850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f510bfff6c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f510c10f200 0x7f510c11d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 -- 10.20.193.90:0/2207295792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f510c115410 msgr2=0x7f510c11d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f510c115410 0x7f510c11d850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.826 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 -- 10.20.193.90:0/2207295792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f510c10f200 msgr2=0x7f510c11d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f510c10f200 0x7f510c11d310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 -- 10.20.193.90:0/2207295792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f8009590 con 0x7f510c122c10 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51109d96c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 0x7f510c1230b0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5100006ea0 tx=0x7f510000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5100003a30 con 0x7f510c122c10 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f51000054f0 con 0x7f510c122c10 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c163e00 con 0x7f510c122c10 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f510000dcd0 con 0x7f510c122c10 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1642e0 con 0x7f510c122c10 2026-02-19T21:09:14.827 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.822+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c1104d0 con 0x7f510c122c10 2026-02-19T21:09:14.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.823+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f5100005030 con 0x7f510c122c10 2026-02-19T21:09:14.828 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.824+0000 7f51097fa6c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f50e00b56d0 0x7f50e00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:14.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.824+0000 7f510bfff6c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f50e00b56d0 0x7f50e00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:14.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.824+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f51000e4cc0 con 0x7f510c122c10 2026-02-19T21:09:14.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.824+0000 7f510bfff6c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f50e00b56d0 0x7f50e00d5b80 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50f80092e0 tx=0x7f50f8005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:14.829 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.824+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f51000ab0d0 con 0x7f510c122c10 2026-02-19T21:09:14.940 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.939+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f510c11e490 con 0x7f510c122c10 2026-02-19T21:09:14.941 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.939+0000 7f51097fa6c0 1 -- 10.20.193.90:0/2207295792 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f510000de60 con 0x7f510c122c10 2026-02-19T21:09:14.941 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:14.941 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:14.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f50e00b56d0 msgr2=0x7f50e00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:14.942 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f50e00b56d0 0x7f50e00d5b80 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50f80092e0 tx=0x7f50f8005c00 comp rx=0 tx=0).stop 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 msgr2=0x7f510c1230b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 0x7f510c1230b0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5100006ea0 tx=0x7f510000cca0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 shutdown_connections 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f50e00b56d0 0x7f50e00d5b80 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f510c122c10 0x7f510c1230b0 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f510c115410 0x7f510c11d850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 --2- 10.20.193.90:0/2207295792 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f510c10f200 0x7f510c11d310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 >> 10.20.193.90:0/2207295792 conn(0x7f510c0ecac0 msgr2=0x7f510c10cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 shutdown_connections 2026-02-19T21:09:14.943 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:14.940+0000 7f51124676c0 1 -- 10.20.193.90:0/2207295792 wait complete. 2026-02-19T21:09:15.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:15 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2207295792' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:15.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:15 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2207295792' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:15.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:15 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2207295792' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:16.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:16 trial105 ceph-mon[33883]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:16.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:16 trial090 ceph-mon[31759]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:16.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:16 trial175 ceph-mon[34116]: pgmap v325: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:17.980 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:18.108 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:18.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.216+0000 7fb0a14356c0 1 -- 10.20.193.90:0/3776349959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c115410 msgr2=0x7fb09c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:18.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.216+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/3776349959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c115410 0x7fb09c175db0 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=8322922932176396340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb08c00aa70 tx=0x7fb08c02fde0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.220 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- 10.20.193.90:0/3776349959 shutdown_connections 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/3776349959 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c115410 0x7fb09c175db0 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=8322922932176396340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/3776349959 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c10fbf0 0x7fb09c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/3776349959 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb09c10f200 0x7fb09c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- 10.20.193.90:0/3776349959 >> 10.20.193.90:0/3776349959 conn(0x7fb09c0eca60 msgr2=0x7fb09c10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- 10.20.193.90:0/3776349959 shutdown_connections 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- 10.20.193.90:0/3776349959 wait complete. 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 Processor -- start 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- start start 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb09c10f200 0x7fb09c11d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c115410 0x7fb09c11d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:18.221 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 0x7fb09c122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c123510 con 0x7fb09c122b00 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c123680 con 0x7fb09c115410 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb0a14356c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c123840 con 0x7fb09c10f200 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 0x7fb09c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 0x7fb09c122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:55452/0 (socket says 10.20.193.90:55452) 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 -- 10.20.193.90:0/862666440 learned_addr learned my addr 10.20.193.90:0/862666440 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09a7fc6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c115410 0x7fb09c11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09affd6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb09c10f200 0x7fb09c11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 -- 10.20.193.90:0/862666440 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb09c10f200 msgr2=0x7fb09c11d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:18.222 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb09c10f200 0x7fb09c11d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 -- 10.20.193.90:0/862666440 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c115410 msgr2=0x7fb09c11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c115410 0x7fb09c11d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 -- 10.20.193.90:0/862666440 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c00a660 con 0x7fb09c122b00 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09a7fc6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c115410 0x7fb09c11d740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.217+0000 7fb09b7fe6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 0x7fb09c122fa0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb08c0054b0 tx=0x7fb08c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.218+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb08c003a30 con 0x7fb09c122b00 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.218+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09c163c90 con 0x7fb09c122b00 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.218+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fb08c003b90 con 0x7fb09c122b00 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.218+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb08c0382f0 con 0x7fb09c122b00 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.218+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09c1640c0 con 0x7fb09c122b00 2026-02-19T21:09:18.223 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.218+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb09c1104d0 con 0x7fb09c122b00 2026-02-19T21:09:18.224 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.220+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fb08c008260 con 0x7fb09c122b00 2026-02-19T21:09:18.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.220+0000 7fb07bfff6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb0700b5650 0x7fb0700d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:18.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.220+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fb08c108ff0 con 0x7fb09c122b00 2026-02-19T21:09:18.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.220+0000 7fb09affd6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb0700b5650 0x7fb0700d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:18.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.220+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb08c0cb9a0 con 0x7fb09c122b00 2026-02-19T21:09:18.225 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.221+0000 7fb09affd6c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb0700b5650 0x7fb0700d5b00 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb090005980 tx=0x7fb090005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:18.337 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.335+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb09c10f5d0 con 0x7fb09c122b00 2026-02-19T21:09:18.337 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.336+0000 7fb07bfff6c0 1 -- 10.20.193.90:0/862666440 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb08c0ceb50 con 0x7fb09c122b00 2026-02-19T21:09:18.338 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:18.338 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb0700b5650 msgr2=0x7fb0700d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb0700b5650 0x7fb0700d5b00 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb090005980 tx=0x7fb090005910 comp rx=0 tx=0).stop 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 msgr2=0x7fb09c122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 0x7fb09c122fa0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb08c0054b0 tx=0x7fb08c0054e0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 shutdown_connections 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fb0700b5650 0x7fb0700d5b00 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fb09c122b00 0x7fb09c122fa0 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.339 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fb09c115410 0x7fb09c11d740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.340 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 --2- 10.20.193.90:0/862666440 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fb09c10f200 0x7fb09c11d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:18.340 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 >> 10.20.193.90:0/862666440 conn(0x7fb09c0eca60 msgr2=0x7fb09c10ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:18.340 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 shutdown_connections 2026-02-19T21:09:18.340 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:18.337+0000 7fb0a14356c0 1 -- 10.20.193.90:0/862666440 wait complete. 2026-02-19T21:09:18.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:18 trial105 ceph-mon[33883]: pgmap v326: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:18.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:18 trial090 ceph-mon[31759]: pgmap v326: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:18.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:18 trial175 ceph-mon[34116]: pgmap v326: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:19.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:19 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/862666440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:19.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:19 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/862666440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:19.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:19 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/862666440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:20.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:20 trial105 ceph-mon[33883]: pgmap v327: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:20.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:20 trial090 ceph-mon[31759]: pgmap v327: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:20.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:20 trial175 ceph-mon[34116]: pgmap v327: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:21.378 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:21.503 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:21.614 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/603254256 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 msgr2=0x7f9e08175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/603254256 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e08175db0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=9670123387318818224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9df800aa70 tx=0x7f9df802fde0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/603254256 shutdown_connections 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/603254256 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e08175db0 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=9670123387318818224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/603254256 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9e0810fbf0 0x7f9e08114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/603254256 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9e0810f200 0x7f9e0810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/603254256 >> 10.20.193.90:0/603254256 conn(0x7f9e080eca60 msgr2=0x7f9e0810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/603254256 shutdown_connections 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/603254256 wait complete. 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 Processor -- start 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.611+0000 7f9e0d4246c0 1 -- start start 2026-02-19T21:09:21.615 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9e0810f200 0x7f9e0811d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e0811d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9e08122b90 0x7f9e08123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e081235a0 con 0x7f9e08115410 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e08123710 con 0x7f9e0810f200 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e081238d0 con 0x7f9e08122b90 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e0811d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e0811d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:55476/0 (socket says 10.20.193.90:55476) 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 -- 10.20.193.90:0/2011704969 learned_addr learned my addr 10.20.193.90:0/2011704969 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e077fe6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9e08122b90 0x7f9e08123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 -- 10.20.193.90:0/2011704969 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9e08122b90 msgr2=0x7f9e08123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9e08122b90 0x7f9e08123030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.616 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 -- 10.20.193.90:0/2011704969 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9e0810f200 msgr2=0x7f9e0811d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9e0810f200 0x7f9e0811d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 -- 10.20.193.90:0/2011704969 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df800a660 con 0x7f9e08115410 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e067fc6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e0811d7d0 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9df0005fd0 tx=0x7f9df000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9df0004280 con 0x7f9e08115410 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f9df00043e0 con 0x7f9e08115410 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e08163d80 con 0x7f9e08115410 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9df000ccd0 con 0x7f9e08115410 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.612+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e08164260 con 0x7f9e08115410 2026-02-19T21:09:21.617 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.613+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e081104d0 con 0x7f9e08115410 2026-02-19T21:09:21.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.614+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f9df00026b0 con 0x7f9e08115410 2026-02-19T21:09:21.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.615+0000 7f9de7fff6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9ddc0b56d0 0x7f9ddc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:21.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.615+0000 7f9e06ffd6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9ddc0b56d0 0x7f9ddc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:21.618 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.615+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f9df00e3ad0 con 0x7f9e08115410 2026-02-19T21:09:21.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.615+0000 7f9e06ffd6c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9ddc0b56d0 0x7f9ddc0d5b80 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dfc005980 tx=0x7f9dfc005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:21.619 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.615+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9df00a9670 con 0x7f9e08115410 2026-02-19T21:09:21.731 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.730+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9e0810f5d0 con 0x7f9e08115410 2026-02-19T21:09:21.731 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.730+0000 7f9de7fff6c0 1 -- 10.20.193.90:0/2011704969 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9df00a9850 con 0x7f9e08115410 2026-02-19T21:09:21.732 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:21.732 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:21.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9ddc0b56d0 msgr2=0x7f9ddc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:21.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9ddc0b56d0 0x7f9ddc0d5b80 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9dfc005980 tx=0x7f9dfc005910 comp rx=0 tx=0).stop 2026-02-19T21:09:21.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 msgr2=0x7f9e0811d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:21.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e0811d7d0 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9df0005fd0 tx=0x7f9df000bca0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 shutdown_connections 2026-02-19T21:09:21.733 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f9ddc0b56d0 0x7f9ddc0d5b80 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f9e08122b90 0x7f9e08123030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f9e08115410 0x7f9e0811d7d0 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 --2- 10.20.193.90:0/2011704969 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f9e0810f200 0x7f9e0811d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:21.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 >> 10.20.193.90:0/2011704969 conn(0x7f9e080eca60 msgr2=0x7f9e0810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:21.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 shutdown_connections 2026-02-19T21:09:21.734 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:21.731+0000 7f9e0d4246c0 1 -- 10.20.193.90:0/2011704969 wait complete. 2026-02-19T21:09:22.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:22 trial105 ceph-mon[33883]: pgmap v328: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:22.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:22 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2011704969' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:22 trial090 ceph-mon[31759]: pgmap v328: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:22.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:22 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2011704969' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:22.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:22 trial175 ceph-mon[34116]: pgmap v328: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:22.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:22 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2011704969' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:24.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:24 trial105 ceph-mon[33883]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:24.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:24 trial090 ceph-mon[31759]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:24.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:24 trial175 ceph-mon[34116]: pgmap v329: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:24.787 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:24.914 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:25.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4058268346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 msgr2=0x7fa47810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:25.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4058268346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47810f5d0 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=14969364549753256906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4700099a0 tx=0x7fa47002ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:25.033 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4058268346 shutdown_connections 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4058268346 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa478115410 0x7fa478175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4058268346 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa47810fbf0 0x7fa478114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4058268346 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47810f5d0 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=14969364549753256906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4058268346 >> 10.20.193.90:0/4058268346 conn(0x7fa4780ecac0 msgr2=0x7fa47810ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4058268346 shutdown_connections 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.030+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4058268346 wait complete. 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 Processor -- start 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 -- start start 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47811d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:25.034 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa478115410 0x7fa47811d800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa478122bc0 0x7fa478123060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781235d0 con 0x7fa47810f200 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa478123740 con 0x7fa478122bc0 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa478123900 con 0x7fa478115410 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47811d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47811d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54268/0 (socket says 10.20.193.90:54268) 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 -- 10.20.193.90:0/4257314295 learned_addr learned my addr 10.20.193.90:0/4257314295 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 -- 10.20.193.90:0/4257314295 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa478115410 msgr2=0x7fa47811d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:25.035 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa478115410 0x7fa47811d800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.037 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 -- 10.20.193.90:0/4257314295 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa478122bc0 msgr2=0x7fa478123060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa478122bc0 0x7fa478123060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 -- 10.20.193.90:0/4257314295 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa470009590 con 0x7fa47810f200 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa47e5dd6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47811d2c0 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa47002f230 tx=0x7fa47002fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa470002ba0 con 0x7fa47810f200 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7fa470002d00 con 0x7fa47810f200 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa478163d50 con 0x7fa47810f200 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.031+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4700372f0 con 0x7fa47810f200 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.032+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4781641d0 con 0x7fa47810f200 2026-02-19T21:09:25.038 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.032+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4781104d0 con 0x7fa47810f200 2026-02-19T21:09:25.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.033+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7fa4700078d0 con 0x7fa47810f200 2026-02-19T21:09:25.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.034+0000 7fa4637fe6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa4540b56d0 0x7fa4540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:25.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.034+0000 7fa47dddc6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa4540b56d0 0x7fa4540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:25.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.034+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7fa470107ca0 con 0x7fa47810f200 2026-02-19T21:09:25.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.034+0000 7fa47dddc6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa4540b56d0 0x7fa4540d5b80 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa464005980 tx=0x7fa464005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:25.039 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.035+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4700ca690 con 0x7fa47810f200 2026-02-19T21:09:25.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.150+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa47810f5d0 con 0x7fa47810f200 2026-02-19T21:09:25.152 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.151+0000 7fa4637fe6c0 1 -- 10.20.193.90:0/4257314295 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa4700cd840 con 0x7fa47810f200 2026-02-19T21:09:25.152 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:25.153 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa4540b56d0 msgr2=0x7fa4540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa4540b56d0 0x7fa4540d5b80 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa464005980 tx=0x7fa464005910 comp rx=0 tx=0).stop 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 msgr2=0x7fa47811d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47811d2c0 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa47002f230 tx=0x7fa47002fd40 comp rx=0 tx=0).stop 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 shutdown_connections 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7fa4540b56d0 0x7fa4540d5b80 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7fa478122bc0 0x7fa478123060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7fa478115410 0x7fa47811d800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.154 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 --2- 10.20.193.90:0/4257314295 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7fa47810f200 0x7fa47811d2c0 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:25.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 >> 10.20.193.90:0/4257314295 conn(0x7fa4780ecac0 msgr2=0x7fa47810cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:25.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 shutdown_connections 2026-02-19T21:09:25.155 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:25.152+0000 7fa48086c6c0 1 -- 10.20.193.90:0/4257314295 wait complete. 2026-02-19T21:09:25.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:25 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4257314295' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:25.644 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:25 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4257314295' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:25.667 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:25 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4257314295' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:26.644 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:26 trial105 ceph-mon[33883]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:26.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:26 trial090 ceph-mon[31759]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:26.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:26 trial175 ceph-mon[34116]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:28.192 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:28.319 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:28.435 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- 10.20.193.90:0/1053745957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f388010f200 msgr2=0x7f388010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:28.435 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- 10.20.193.90:0/1053745957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f388010f200 0x7f388010f5d0 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=3207016524851334450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f386c0099a0 tx=0x7f386c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:28.435 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- 10.20.193.90:0/1053745957 shutdown_connections 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- 10.20.193.90:0/1053745957 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f3880115410 0x7f3880175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- 10.20.193.90:0/1053745957 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f388010fbf0 0x7f3880114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- 10.20.193.90:0/1053745957 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f388010f200 0x7f388010f5d0 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=3207016524851334450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- 10.20.193.90:0/1053745957 >> 10.20.193.90:0/1053745957 conn(0x7f38800eca60 msgr2=0x7f388010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- 10.20.193.90:0/1053745957 shutdown_connections 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- 10.20.193.90:0/1053745957 wait complete. 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 Processor -- start 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- start start 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f388010f200 0x7f388011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 0x7f388011d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3880122bf0 0x7f3880123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:28.436 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3880123600 con 0x7f3880115410 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3880123770 con 0x7f388010f200 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.432+0000 7f38867a46c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3880123930 con 0x7f3880122bf0 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 0x7f388011d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 0x7f388011d830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54282/0 (socket says 10.20.193.90:54282) 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 -- 10.20.193.90:0/4106773052 learned_addr learned my addr 10.20.193.90:0/4106773052 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f3884d166c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3880122bf0 0x7f3880123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 -- 10.20.193.90:0/4106773052 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3880122bf0 msgr2=0x7f3880123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3880122bf0 0x7f3880123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 -- 10.20.193.90:0/4106773052 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f388010f200 msgr2=0x7f388011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f388010f200 0x7f388011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.437 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 -- 10.20.193.90:0/4106773052 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c009590 con 0x7f3880115410 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387f7fe6c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 0x7f388011d830 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387000b6c0 tx=0x7f387000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3870004250 con 0x7f3880115410 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f3870009070 con 0x7f3880115410 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3880163de0 con 0x7f3880115410 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f387000ccb0 con 0x7f3880115410 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3880164270 con 0x7f3880115410 2026-02-19T21:09:28.438 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.433+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38801104d0 con 0x7f3880115410 2026-02-19T21:09:28.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.435+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f38700028c0 con 0x7f3880115410 2026-02-19T21:09:28.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.435+0000 7f387d7fa6c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38540b5650 0x7f38540d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:28.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.436+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f38700e3c10 con 0x7f3880115410 2026-02-19T21:09:28.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.436+0000 7f387ffff6c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38540b5650 0x7f38540d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:28.439 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.436+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f38700e4100 con 0x7f3880115410 2026-02-19T21:09:28.440 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.436+0000 7f387ffff6c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38540b5650 0x7f38540d5b00 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f386c005b40 tx=0x7f386c005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:28.552 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.550+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f388011e4a0 con 0x7f3880115410 2026-02-19T21:09:28.552 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:28 trial090 ceph-mon[31759]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:28.552 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.551+0000 7f387d7fa6c0 1 -- 10.20.193.90:0/4106773052 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f38700a6600 con 0x7f3880115410 2026-02-19T21:09:28.553 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:28.553 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.551+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38540b5650 msgr2=0x7f38540d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.551+0000 7f38867a46c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38540b5650 0x7f38540d5b00 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f386c005b40 tx=0x7f386c005c60 comp rx=0 tx=0).stop 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 msgr2=0x7f388011d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 0x7f388011d830 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f387000b6c0 tx=0x7f387000bb90 comp rx=0 tx=0).stop 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 shutdown_connections 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f38540b5650 0x7f38540d5b00 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.554 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f3880122bf0 0x7f3880123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.555 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f3880115410 0x7f388011d830 unknown :-1 s=CLOSED pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.555 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 --2- 10.20.193.90:0/4106773052 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f388010f200 0x7f388011d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:28.555 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 >> 10.20.193.90:0/4106773052 conn(0x7f38800eca60 msgr2=0x7f388010ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:28.555 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 shutdown_connections 2026-02-19T21:09:28.555 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:28.552+0000 7f38867a46c0 1 -- 10.20.193.90:0/4106773052 wait complete. 2026-02-19T21:09:28.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:28 trial105 ceph-mon[33883]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:28.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:28 trial175 ceph-mon[34116]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:29.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:29 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/4106773052' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:29.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:29 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/4106773052' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:29.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:29 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/4106773052' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:30.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:30 trial105 ceph-mon[33883]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:30.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:30 trial090 ceph-mon[31759]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:30.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:30 trial175 ceph-mon[34116]: pgmap v332: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-19T21:09:31.595 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:31.720 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:31.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/4025748083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd810f200 msgr2=0x7f5cd810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:31.845 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/4025748083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd810f200 0x7f5cd810f5d0 secure :-1 s=READY pgs=474 gs=1 cs=0 l=1 c_cookie=10270391479165372471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc80099a0 tx=0x7f5cc802ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/4025748083 shutdown_connections 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/4025748083 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5cd8115410 0x7f5cd8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/4025748083 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5cd810fbf0 0x7f5cd8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/4025748083 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd810f200 0x7f5cd810f5d0 unknown :-1 s=CLOSED pgs=474 gs=1 cs=0 l=1 c_cookie=10270391479165372471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/4025748083 >> 10.20.193.90:0/4025748083 conn(0x7f5cd80eca60 msgr2=0x7f5cd810ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/4025748083 shutdown_connections 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/4025748083 wait complete. 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 Processor -- start 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.842+0000 7f5cdfab86c0 1 -- start start 2026-02-19T21:09:31.846 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5cd810f200 0x7f5cd811d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 0x7f5cd811d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5cd8122c80 0x7f5cd8123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd8123660 con 0x7f5cd8115410 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd81237d0 con 0x7f5cd8122c80 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd8123990 con 0x7f5cd810f200 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 0x7f5cd811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 0x7f5cd811d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:54296/0 (socket says 10.20.193.90:54296) 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 -- 10.20.193.90:0/138376121 learned_addr learned my addr 10.20.193.90:0/138376121 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd82d6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5cd810f200 0x7f5cd811d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cde02e6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5cd8122c80 0x7f5cd8123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 -- 10.20.193.90:0/138376121 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5cd810f200 msgr2=0x7f5cd811d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5cd810f200 0x7f5cd811d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.847 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 -- 10.20.193.90:0/138376121 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5cd8122c80 msgr2=0x7f5cd8123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5cd8122c80 0x7f5cd8123120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 -- 10.20.193.90:0/138376121 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc8009590 con 0x7f5cd8115410 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdd02c6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 0x7f5cd811d8c0 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc00b650 tx=0x7f5ccc00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ccc0044a0 con 0x7f5cd8115410 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5ccc009030 con 0x7f5cd8115410 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd8163e10 con 0x7f5cd8115410 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5ccc00cc10 con 0x7f5cd8115410 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.843+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd8164340 con 0x7f5cd8115410 2026-02-19T21:09:31.848 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.844+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd81104d0 con 0x7f5cd8115410 2026-02-19T21:09:31.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.845+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f5ccc0026b0 con 0x7f5cd8115410 2026-02-19T21:09:31.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.846+0000 7f5cc6ffd6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5cb40b56d0 0x7f5cb40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:31.849 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.846+0000 7f5cdd82d6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5cb40b56d0 0x7f5cb40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:31.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.846+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f5ccc0e3ad0 con 0x7f5cd8115410 2026-02-19T21:09:31.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.846+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5ccc0a9f20 con 0x7f5cd8115410 2026-02-19T21:09:31.850 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.846+0000 7f5cdd82d6c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5cb40b56d0 0x7f5cb40d5b80 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc80092e0 tx=0x7f5cc8005c00 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:31.963 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.961+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5cd811e4d0 con 0x7f5cd8115410 2026-02-19T21:09:31.963 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.961+0000 7f5cc6ffd6c0 1 -- 10.20.193.90:0/138376121 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5ccc0abf90 con 0x7f5cd8115410 2026-02-19T21:09:31.963 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:31.963 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:31.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.962+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5cb40b56d0 msgr2=0x7f5cb40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:31.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.962+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5cb40b56d0 0x7f5cb40d5b80 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc80092e0 tx=0x7f5cc8005c00 comp rx=0 tx=0).stop 2026-02-19T21:09:31.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.962+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 msgr2=0x7f5cd811d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:31.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.962+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 0x7f5cd811d8c0 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ccc00b650 tx=0x7f5ccc00bb20 comp rx=0 tx=0).stop 2026-02-19T21:09:31.964 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 shutdown_connections 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f5cb40b56d0 0x7f5cb40d5b80 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5cd8122c80 0x7f5cd8123120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5cd8115410 0x7f5cd811d8c0 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 --2- 10.20.193.90:0/138376121 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f5cd810f200 0x7f5cd811d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 >> 10.20.193.90:0/138376121 conn(0x7f5cd80eca60 msgr2=0x7f5cd810ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 shutdown_connections 2026-02-19T21:09:31.965 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:31.963+0000 7f5cdfab86c0 1 -- 10.20.193.90:0/138376121 wait complete. 2026-02-19T21:09:32.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:32 trial105 ceph-mon[33883]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:32.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:32 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/138376121' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:32.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:32 trial090 ceph-mon[31759]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:32.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:32 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/138376121' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:32.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:32 trial175 ceph-mon[34116]: pgmap v333: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 4 op/s 2026-02-19T21:09:32.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:32 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/138376121' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:33.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:33 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:09:33.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:33 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:09:33.693 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:33 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-19T21:09:34.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:34.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:09:34.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:09:34.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:09:34.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:09:34.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:09:34.646 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:34 trial105 ceph-mon[33883]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:09:34.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:34.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:09:34.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:09:34.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:09:34.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:09:34.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:09:34.657 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:34 trial090 ceph-mon[31759]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: pgmap v334: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-19T21:09:34.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:34 trial175 ceph-mon[34116]: from='mgr.14193 10.20.193.90:0/3143096340' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-19T21:09:35.004 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:35.131 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:35.252 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- 10.20.193.90:0/2803648793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6824113170 msgr2=0x7f6824173b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:35.252 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/2803648793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6824113170 0x7f6824173b10 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=1591154730635270981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f682000aa70 tx=0x7f682002fde0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.252 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- 10.20.193.90:0/2803648793 shutdown_connections 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/2803648793 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f6824113170 0x7f6824173b10 unknown :-1 s=CLOSED pgs=476 gs=1 cs=0 l=1 c_cookie=1591154730635270981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/2803648793 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f682410d950 0x7f6824112990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/2803648793 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f682410cf60 0x7f682410d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- 10.20.193.90:0/2803648793 >> 10.20.193.90:0/2803648793 conn(0x7f68240ea840 msgr2=0x7f682410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- 10.20.193.90:0/2803648793 shutdown_connections 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- 10.20.193.90:0/2803648793 wait complete. 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 Processor -- start 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- start start 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 0x7f68240606c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:35.253 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6824113170 0x7f6824060c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6824061140 0x7f68241631e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f68240626c0 con 0x7f682410cf60 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6824163720 con 0x7f6824113170 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682c2e96c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68241638e0 con 0x7f6824061140 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 0x7f68240606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 0x7f68240606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37376/0 (socket says 10.20.193.90:37376) 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 -- 10.20.193.90:0/477602909 learned_addr learned my addr 10.20.193.90:0/477602909 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f68298596c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6824113170 0x7f6824060c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a85b6c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6824061140 0x7f68241631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 -- 10.20.193.90:0/477602909 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6824061140 msgr2=0x7f68241631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:35.254 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6824061140 0x7f68241631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 -- 10.20.193.90:0/477602909 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6824113170 msgr2=0x7f6824060c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6824113170 0x7f6824060c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 -- 10.20.193.90:0/477602909 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682000a660 con 0x7f682410cf60 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a85b6c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6824061140 0x7f68241631e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.249+0000 7f682a05a6c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 0x7f68240606c0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6814005dc0 tx=0x7f681400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.250+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6814004250 con 0x7f682410cf60 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.250+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f6814009070 con 0x7f682410cf60 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.250+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6824163bc0 con 0x7f682410cf60 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.250+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f681400cd70 con 0x7f682410cf60 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.250+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68241640a0 con 0x7f682410cf60 2026-02-19T21:09:35.255 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.250+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682410e230 con 0x7f682410cf60 2026-02-19T21:09:35.256 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.251+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f68140028c0 con 0x7f682410cf60 2026-02-19T21:09:35.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.252+0000 7f680b7fe6c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f68000b56d0 0x7f68000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:35.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.252+0000 7f68298596c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f68000b56d0 0x7f68000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:35.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.252+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f68140e3b30 con 0x7f682410cf60 2026-02-19T21:09:35.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.252+0000 7f68298596c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f68000b56d0 0x7f68000d5b80 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f682410fa30 tx=0x7f6818005e60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:35.257 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.252+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f68140a64e0 con 0x7f682410cf60 2026-02-19T21:09:35.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.367+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f682410d330 con 0x7f682410cf60 2026-02-19T21:09:35.369 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.367+0000 7f680b7fe6c0 1 -- 10.20.193.90:0/477602909 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f68140a9690 con 0x7f682410cf60 2026-02-19T21:09:35.369 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:35.369 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:35.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f68000b56d0 msgr2=0x7f68000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:35.370 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f68000b56d0 0x7f68000d5b80 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f682410fa30 tx=0x7f6818005e60 comp rx=0 tx=0).stop 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 msgr2=0x7f68240606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 0x7f68240606c0 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6814005dc0 tx=0x7f681400bbb0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 shutdown_connections 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f68000b56d0 0x7f68000d5b80 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f6824061140 0x7f68241631e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f6824113170 0x7f6824060c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 --2- 10.20.193.90:0/477602909 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f682410cf60 0x7f68240606c0 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.368+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 >> 10.20.193.90:0/477602909 conn(0x7f68240ea840 msgr2=0x7f682410ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.369+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 shutdown_connections 2026-02-19T21:09:35.371 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:35.369+0000 7f682c2e96c0 1 -- 10.20.193.90:0/477602909 wait complete. 2026-02-19T21:09:35.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:35 trial105 ceph-mon[33883]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 7 op/s 2026-02-19T21:09:35.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:35 trial105 ceph-mon[33883]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:35.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:35 trial090 ceph-mon[31759]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 7 op/s 2026-02-19T21:09:35.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:35 trial090 ceph-mon[31759]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:35.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:35 trial175 ceph-mon[34116]: pgmap v335: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.9 KiB/s rd, 7 op/s 2026-02-19T21:09:35.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:35 trial175 ceph-mon[34116]: pgmap v336: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:36.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:36 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/477602909' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:36.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:36 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/477602909' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:36.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:36 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/477602909' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:37.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:37 trial105 ceph-mon[33883]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:37.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:37 trial090 ceph-mon[31759]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:37.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:37 trial175 ceph-mon[34116]: pgmap v337: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:38.410 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:38.536 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:38.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:38 trial105 ceph-mon[33883]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2845832797 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e010fbf0 msgr2=0x7f04e0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2845832797 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e010fbf0 0x7f04e0114c30 secure :-1 s=READY pgs=478 gs=1 cs=0 l=1 c_cookie=5595051066944075136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d00098d0 tx=0x7f04d002ec40 comp rx=0 tx=0).stop 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2845832797 shutdown_connections 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2845832797 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e0115410 0x7f04e0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2845832797 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e010fbf0 0x7f04e0114c30 unknown :-1 s=CLOSED pgs=478 gs=1 cs=0 l=1 c_cookie=5595051066944075136 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2845832797 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e010f200 0x7f04e010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.646 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2845832797 >> 10.20.193.90:0/2845832797 conn(0x7f04e00ecac0 msgr2=0x7f04e010ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:38.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2845832797 shutdown_connections 2026-02-19T21:09:38.647 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.644+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2845832797 wait complete. 2026-02-19T21:09:38.647 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:38 trial090 ceph-mon[31759]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 Processor -- start 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 -- start start 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e010f200 0x7f04e00f4bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 0x7f04e0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e00f5220 0x7f04e00fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04e00f5910 con 0x7f04e0115410 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04e00faa30 con 0x7f04e00f5220 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f04e00fabf0 con 0x7f04e010f200 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 0x7f04e0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:38.650 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 0x7f04e0175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37382/0 (socket says 10.20.193.90:37382) 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 -- 10.20.193.90:0/2579429234 learned_addr learned my addr 10.20.193.90:0/2579429234 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 -- 10.20.193.90:0/2579429234 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e010f200 msgr2=0x7f04e00f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e010f200 0x7f04e00f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 -- 10.20.193.90:0/2579429234 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e00f5220 msgr2=0x7f04e00fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04dffff6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e00f5220 0x7f04e00fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e00f5220 0x7f04e00fa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 -- 10.20.193.90:0/2579429234 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d00094c0 con 0x7f04e0115410 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04dffff6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e00f5220 0x7f04e00fa4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04deffd6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 0x7f04e0175cb0 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d00023a0 tx=0x7f04d002fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04d0002ae0 con 0x7f04e0115410 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f04d0002c40 con 0x7f04e0115410 2026-02-19T21:09:38.651 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04d0031030 con 0x7f04e0115410 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e00fae70 con 0x7f04e0115410 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.645+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e00fb2a0 con 0x7f04e0115410 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.646+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e01104d0 con 0x7f04e0115410 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.647+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f04d00071c0 con 0x7f04e0115410 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.648+0000 7f04dcff96c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04b40b56d0 0x7f04b40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.648+0000 7f04df7fe6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04b40b56d0 0x7f04b40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.648+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f04d0107d50 con 0x7f04e0115410 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.648+0000 7f04df7fe6c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04b40b56d0 0x7f04b40d5b80 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04cc004750 tx=0x7f04cc0096a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:38.652 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.648+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f04d00ca700 con 0x7f04e0115410 2026-02-19T21:09:38.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:38 trial175 ceph-mon[34116]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 1.7 KiB/s rd, 3 op/s 2026-02-19T21:09:38.767 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.766+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f04e010fbf0 con 0x7f04e0115410 2026-02-19T21:09:38.768 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.766+0000 7f04dcff96c0 1 -- 10.20.193.90:0/2579429234 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f04d00cd8b0 con 0x7f04e0115410 2026-02-19T21:09:38.768 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:38.768 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:38.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04b40b56d0 msgr2=0x7f04b40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:38.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04b40b56d0 0x7f04b40d5b80 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04cc004750 tx=0x7f04cc0096a0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 msgr2=0x7f04e0175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:38.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 0x7f04e0175cb0 secure :-1 s=READY pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04d00023a0 tx=0x7f04d002fb20 comp rx=0 tx=0).stop 2026-02-19T21:09:38.769 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 shutdown_connections 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f04b40b56d0 0x7f04b40d5b80 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f04e00f5220 0x7f04e00fa4f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f04e0115410 0x7f04e0175cb0 unknown :-1 s=CLOSED pgs=479 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 --2- 10.20.193.90:0/2579429234 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f04e010f200 0x7f04e00f4bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 >> 10.20.193.90:0/2579429234 conn(0x7f04e00ecac0 msgr2=0x7f04e0113c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 shutdown_connections 2026-02-19T21:09:38.770 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:38.767+0000 7f04e5fd76c0 1 -- 10.20.193.90:0/2579429234 wait complete. 2026-02-19T21:09:39.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:39 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/2579429234' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:39.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:39 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/2579429234' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:39.766 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:39 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/2579429234' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:40.645 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:40 trial105 ceph-mon[33883]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:40.656 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:40 trial090 ceph-mon[31759]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:40.765 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:40 trial175 ceph-mon[34116]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:41.807 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:41.933 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:42.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- 10.20.193.90:0/1414872665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 msgr2=0x7f7a7010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:42.060 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- 10.20.193.90:0/1414872665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7010f5d0 secure :-1 s=READY pgs=480 gs=1 cs=0 l=1 c_cookie=7108808470340689203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a640099a0 tx=0x7f7a6402ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- 10.20.193.90:0/1414872665 shutdown_connections 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- 10.20.193.90:0/1414872665 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7a70115410 0x7f7a70175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- 10.20.193.90:0/1414872665 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a7010fbf0 0x7f7a70114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- 10.20.193.90:0/1414872665 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7010f5d0 unknown :-1 s=CLOSED pgs=480 gs=1 cs=0 l=1 c_cookie=7108808470340689203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- 10.20.193.90:0/1414872665 >> 10.20.193.90:0/1414872665 conn(0x7f7a700eca60 msgr2=0x7f7a7010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- 10.20.193.90:0/1414872665 shutdown_connections 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- 10.20.193.90:0/1414872665 wait complete. 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 Processor -- start 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- start start 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7a70115410 0x7f7a7011d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:42.061 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a70122bf0 0x7f7a70123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70123600 con 0x7f7a7010f200 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70123770 con 0x7f7a70115410 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a753196c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7a70123930 con 0x7f7a70122bf0 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a6effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a6effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7011d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:37404/0 (socket says 10.20.193.90:37404) 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.057+0000 7f7a6effd6c0 1 -- 10.20.193.90:0/743495541 learned_addr learned my addr 10.20.193.90:0/743495541 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6f7fe6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a70122bf0 0x7f7a70123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6effd6c0 1 -- 10.20.193.90:0/743495541 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a70122bf0 msgr2=0x7f7a70123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6effd6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a70122bf0 0x7f7a70123090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6effd6c0 1 -- 10.20.193.90:0/743495541 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7a70115410 msgr2=0x7f7a7011d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:42.062 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6effd6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7a70115410 0x7f7a7011d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6effd6c0 1 -- 10.20.193.90:0/743495541 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a64009590 con 0x7f7a7010f200 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6f7fe6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a70122bf0 0x7f7a70123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a6effd6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7011d2f0 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a6402f230 tx=0x7f7a6402fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a64002ba0 con 0x7f7a7010f200 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f7a64002d00 con 0x7f7a7010f200 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a70163d80 con 0x7f7a7010f200 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7a640372f0 con 0x7f7a7010f200 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a70164200 con 0x7f7a7010f200 2026-02-19T21:09:42.063 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.058+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a701104d0 con 0x7f7a7010f200 2026-02-19T21:09:42.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.059+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f7a640078d0 con 0x7f7a7010f200 2026-02-19T21:09:42.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.060+0000 7f7a4ffff6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7a440b56d0 0x7f7a440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:42.064 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.060+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f7a64107ce0 con 0x7f7a7010f200 2026-02-19T21:09:42.065 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.060+0000 7f7a6e7fc6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7a440b56d0 0x7f7a440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:42.065 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.060+0000 7f7a6e7fc6c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7a440b56d0 0x7f7a440d5b80 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a58005980 tx=0x7f7a58005910 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:42.065 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.061+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7a640ca690 con 0x7f7a7010f200 2026-02-19T21:09:42.175 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.174+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7a7010fbf0 con 0x7f7a7010f200 2026-02-19T21:09:42.176 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.174+0000 7f7a4ffff6c0 1 -- 10.20.193.90:0/743495541 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7a640cd840 con 0x7f7a7010f200 2026-02-19T21:09:42.176 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:42.176 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:42.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7a440b56d0 msgr2=0x7f7a440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:42.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7a440b56d0 0x7f7a440d5b80 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a58005980 tx=0x7f7a58005910 comp rx=0 tx=0).stop 2026-02-19T21:09:42.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 msgr2=0x7f7a7011d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:42.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7011d2f0 secure :-1 s=READY pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7a6402f230 tx=0x7f7a6402fd40 comp rx=0 tx=0).stop 2026-02-19T21:09:42.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 shutdown_connections 2026-02-19T21:09:42.177 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f7a440b56d0 0x7f7a440d5b80 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.178 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f7a70122bf0 0x7f7a70123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.178 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f7a70115410 0x7f7a7011d830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.178 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 --2- 10.20.193.90:0/743495541 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f7a7010f200 0x7f7a7011d2f0 unknown :-1 s=CLOSED pgs=481 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:42.178 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 >> 10.20.193.90:0/743495541 conn(0x7f7a700eca60 msgr2=0x7f7a7010ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:42.178 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 shutdown_connections 2026-02-19T21:09:42.178 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:42.175+0000 7f7a753196c0 1 -- 10.20.193.90:0/743495541 wait complete. 2026-02-19T21:09:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:43 trial105 ceph-mon[33883]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:43.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:43 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/743495541' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:43.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:43 trial090 ceph-mon[31759]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:43.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:43 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/743495541' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:43.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:43 trial175 ceph-mon[34116]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 6 op/s 2026-02-19T21:09:43.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:43 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/743495541' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:45.216 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:45.345 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:45.365 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:45 trial090 ceph-mon[31759]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:09:45.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:45 trial105 ceph-mon[33883]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:09:45.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 -- 10.20.193.90:0/549112968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc10f200 msgr2=0x7f00dc10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:45.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 --2- 10.20.193.90:0/549112968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc10f200 0x7f00dc10f5d0 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=1839121063112203959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c80099a0 tx=0x7f00c802ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:45.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 -- 10.20.193.90:0/549112968 shutdown_connections 2026-02-19T21:09:45.458 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 --2- 10.20.193.90:0/549112968 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f00dc115410 0x7f00dc175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 --2- 10.20.193.90:0/549112968 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc10fbf0 0x7f00dc114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 --2- 10.20.193.90:0/549112968 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc10f200 0x7f00dc10f5d0 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=1839121063112203959 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 -- 10.20.193.90:0/549112968 >> 10.20.193.90:0/549112968 conn(0x7f00dc0eca60 msgr2=0x7f00dc10ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 -- 10.20.193.90:0/549112968 shutdown_connections 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 -- 10.20.193.90:0/549112968 wait complete. 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 Processor -- start 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.455+0000 7f00e21306c0 1 -- start start 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f00dc10f200 0x7f00dc11d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 0x7f00dc11d8c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc122c80 0x7f00dc123120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:45.459 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc123690 con 0x7f00dc115410 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc123800 con 0x7f00dc122c80 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f00dc1239c0 con 0x7f00dc10f200 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 0x7f00dc11d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 0x7f00dc11d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:51988/0 (socket says 10.20.193.90:51988) 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 -- 10.20.193.90:0/1419238674 learned_addr learned my addr 10.20.193.90:0/1419238674 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00db7fe6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f00dc10f200 0x7f00dc11d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00dbfff6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc122c80 0x7f00dc123120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 -- 10.20.193.90:0/1419238674 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f00dc10f200 msgr2=0x7f00dc11d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f00dc10f200 0x7f00dc11d380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 -- 10.20.193.90:0/1419238674 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc122c80 msgr2=0x7f00dc123120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc122c80 0x7f00dc123120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.460 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 -- 10.20.193.90:0/1419238674 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c8009590 con 0x7f00dc115410 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00dbfff6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc122c80 0x7f00dc123120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00daffd6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 0x7f00dc11d8c0 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00cc00b6c0 tx=0x7f00cc00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00cc0044a0 con 0x7f00dc115410 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f00cc009030 con 0x7f00dc115410 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00cc00cc10 con 0x7f00dc115410 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00dc163e70 con 0x7f00dc115410 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.456+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00dc164300 con 0x7f00dc115410 2026-02-19T21:09:45.461 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.457+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00dc1104d0 con 0x7f00dc115410 2026-02-19T21:09:45.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.458+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f00cc0026b0 con 0x7f00dc115410 2026-02-19T21:09:45.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.459+0000 7f00d8ff96c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f00b00b56d0 0x7f00b00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:45.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.459+0000 7f00db7fe6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f00b00b56d0 0x7f00b00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:45.462 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.459+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f00cc0e3920 con 0x7f00dc115410 2026-02-19T21:09:45.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.459+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00cc0a62d0 con 0x7f00dc115410 2026-02-19T21:09:45.463 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.459+0000 7f00db7fe6c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f00b00b56d0 0x7f00b00d5b80 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c8005b40 tx=0x7f00c80023a0 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:45.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:45 trial175 ceph-mon[34116]: pgmap v341: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 6 op/s 2026-02-19T21:09:45.574 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.573+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00dc11e500 con 0x7f00dc115410 2026-02-19T21:09:45.575 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.573+0000 7f00d8ff96c0 1 -- 10.20.193.90:0/1419238674 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00cc0a9480 con 0x7f00dc115410 2026-02-19T21:09:45.575 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:45.575 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:45.576 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f00b00b56d0 msgr2=0x7f00b00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f00b00b56d0 0x7f00b00d5b80 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c8005b40 tx=0x7f00c80023a0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 msgr2=0x7f00dc11d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 0x7f00dc11d8c0 secure :-1 s=READY pgs=483 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00cc00b6c0 tx=0x7f00cc00bb90 comp rx=0 tx=0).stop 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 shutdown_connections 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f00b00b56d0 0x7f00b00d5b80 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f00dc122c80 0x7f00dc123120 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f00dc115410 0x7f00dc11d8c0 unknown :-1 s=CLOSED pgs=483 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.577 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 --2- 10.20.193.90:0/1419238674 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f00dc10f200 0x7f00dc11d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:45.578 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 >> 10.20.193.90:0/1419238674 conn(0x7f00dc0eca60 msgr2=0x7f00dc10ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:45.578 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 shutdown_connections 2026-02-19T21:09:45.578 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:45.574+0000 7f00e21306c0 1 -- 10.20.193.90:0/1419238674 wait complete. 2026-02-19T21:09:46.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:46 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/1419238674' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:46.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:46 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/1419238674' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:46.515 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:46 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/1419238674' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:47.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:47 trial105 ceph-mon[33883]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:47.406 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:47 trial090 ceph-mon[31759]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:47.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:47 trial175 ceph-mon[34116]: pgmap v342: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:48.613 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph health --format=json 2026-02-19T21:09:48.740 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:48.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- 10.20.193.90:0/1507489599 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f539010f200 msgr2=0x7f539010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:48.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- 10.20.193.90:0/1507489599 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f539010f200 0x7f539010f5d0 secure :-1 s=READY pgs=484 gs=1 cs=0 l=1 c_cookie=18167942426476497356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f537c0099a0 tx=0x7f537c02ed20 comp rx=0 tx=0).stop 2026-02-19T21:09:48.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- 10.20.193.90:0/1507489599 shutdown_connections 2026-02-19T21:09:48.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- 10.20.193.90:0/1507489599 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5390115410 0x7f5390175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.866 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- 10.20.193.90:0/1507489599 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f539010fbf0 0x7f5390114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- 10.20.193.90:0/1507489599 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f539010f200 0x7f539010f5d0 unknown :-1 s=CLOSED pgs=484 gs=1 cs=0 l=1 c_cookie=18167942426476497356 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- 10.20.193.90:0/1507489599 >> 10.20.193.90:0/1507489599 conn(0x7f53900eca60 msgr2=0x7f539010ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- 10.20.193.90:0/1507489599 shutdown_connections 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- 10.20.193.90:0/1507489599 wait complete. 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 Processor -- start 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- start start 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f539010f200 0x7f539011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 0x7f539011d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 --2- >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5390122bf0 0x7f5390123090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5390123600 con 0x7f5390115410 2026-02-19T21:09:48.867 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- --> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5390123770 con 0x7f5390122bf0 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f53961616c0 1 -- --> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5390123930 con 0x7f539010f200 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f538effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 0x7f539011d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f538effd6c0 1 --2- >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 0x7f539011d830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.90:3300/0 says I am v2:10.20.193.90:52012/0 (socket says 10.20.193.90:52012) 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.864+0000 7f538effd6c0 1 -- 10.20.193.90:0/3536574425 learned_addr learned my addr 10.20.193.90:0/3536574425 (peer_addr_for_me v2:10.20.193.90:0/0) 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538effd6c0 1 -- 10.20.193.90:0/3536574425 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f539010f200 msgr2=0x7f539011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538effd6c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f539010f200 0x7f539011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538effd6c0 1 -- 10.20.193.90:0/3536574425 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5390122bf0 msgr2=0x7f5390123090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538ffff6c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5390122bf0 0x7f5390123090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538effd6c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5390122bf0 0x7f5390123090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538effd6c0 1 -- 10.20.193.90:0/3536574425 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c009590 con 0x7f5390115410 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538effd6c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 0x7f539011d830 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f538000b6c0 tx=0x7f538000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:48.868 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f53800044a0 con 0x7f5390115410 2026-02-19T21:09:48.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 2 ==== config(27 keys) ==== 1112+0+0 (secure 0 0 0) 0x7f5380009030 con 0x7f5390115410 2026-02-19T21:09:48.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5390163de0 con 0x7f5390115410 2026-02-19T21:09:48.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f538000cc10 con 0x7f5390115410 2026-02-19T21:09:48.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5390164270 con 0x7f5390115410 2026-02-19T21:09:48.869 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.865+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53901104d0 con 0x7f5390115410 2026-02-19T21:09:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.867+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 4 ==== mgrmap(e 16) ==== 157083+0+0 (secure 0 0 0) 0x7f53800026b0 con 0x7f5390115410 2026-02-19T21:09:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.867+0000 7f538cff96c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f53640b56d0 0x7f53640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-19T21:09:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.867+0000 7f538f7fe6c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f53640b56d0 0x7f53640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-19T21:09:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.867+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8209+0+0 (secure 0 0 0) 0x7f53800e3a50 con 0x7f5390115410 2026-02-19T21:09:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.867+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f53800a9e60 con 0x7f5390115410 2026-02-19T21:09:48.870 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.868+0000 7f538f7fe6c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f53640b56d0 0x7f53640d5b80 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f537c005b40 tx=0x7f537c005c60 comp rx=0 tx=0).ready entity=mgr.14193 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-19T21:09:48.985 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.984+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 --> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f539010f5d0 con 0x7f5390115410 2026-02-19T21:09:48.985 INFO:teuthology.orchestra.run.trial090.stdout: 2026-02-19T21:09:48.985 INFO:teuthology.orchestra.run.trial090.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-19T21:09:48.986 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.984+0000 7f538cff96c0 1 -- 10.20.193.90:0/3536574425 <== mon.0 v2:10.20.193.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f53800a95b0 con 0x7f5390115410 2026-02-19T21:09:48.986 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f53640b56d0 msgr2=0x7f53640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:48.986 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f53640b56d0 0x7f53640d5b80 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f537c005b40 tx=0x7f537c005c60 comp rx=0 tx=0).stop 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 msgr2=0x7f539011d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 0x7f539011d830 secure :-1 s=READY pgs=485 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f538000b6c0 tx=0x7f538000bb90 comp rx=0 tx=0).stop 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 shutdown_connections 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:6800/151235046,v1:10.20.193.90:6801/151235046] conn(0x7f53640b56d0 0x7f53640d5b80 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.105:3300/0,v1:10.20.193.105:6789/0] conn(0x7f5390122bf0 0x7f5390123090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.90:3300/0,v1:10.20.193.90:6789/0] conn(0x7f5390115410 0x7f539011d830 unknown :-1 s=CLOSED pgs=485 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 --2- 10.20.193.90:0/3536574425 >> [v2:10.20.193.175:3300/0,v1:10.20.193.175:6789/0] conn(0x7f539010f200 0x7f539011d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 >> 10.20.193.90:0/3536574425 conn(0x7f53900eca60 msgr2=0x7f539010ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 shutdown_connections 2026-02-19T21:09:48.987 INFO:teuthology.orchestra.run.trial090.stderr:2026-02-19T21:09:48.985+0000 7f53961616c0 1 -- 10.20.193.90:0/3536574425 wait complete. 2026-02-19T21:09:49.026 INFO:tasks.cephadm:Teardown begin 2026-02-19T21:09:49.026 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-19T21:09:49.030 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:09:49.059 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:09:49.090 DEBUG:teuthology.orchestra.run.trial175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:09:49.120 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-19T21:09:49.121 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:a1ac97f8290bb2544f44f608df68f43689827c55-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-19T21:09:49.243 INFO:teuthology.orchestra.run.trial090.stderr:Inferring config /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/mon.a/config 2026-02-19T21:09:49.261 INFO:teuthology.orchestra.run.trial090.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-19T21:09:49.262 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:49 trial090 ceph-mon[31759]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:49.262 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:49 trial090 ceph-mon[31759]: from='client.? 10.20.193.90:0/3536574425' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:49.278 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-19T21:09:49.279 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-19T21:09:49.279 DEBUG:teuthology.orchestra.run.trial090:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-19T21:09:49.298 DEBUG:teuthology.orchestra.run.trial105:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-19T21:09:49.317 DEBUG:teuthology.orchestra.run.trial175:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-19T21:09:49.336 INFO:tasks.cephadm:Stopping all daemons... 2026-02-19T21:09:49.337 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-19T21:09:49.337 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a 2026-02-19T21:09:49.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:49 trial105 ceph-mon[33883]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:49.395 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:49 trial105 ceph-mon[33883]: from='client.? 10.20.193.90:0/3536574425' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:49.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:49 trial175 ceph-mon[34116]: pgmap v343: 97 pgs: 97 active+clean; 650 KiB data, 328 MiB used, 8.2 TiB / 8.2 TiB avail; 2.5 KiB/s rd, 5 op/s 2026-02-19T21:09:49.516 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:49 trial175 ceph-mon[34116]: from='client.? 10.20.193.90:0/3536574425' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-19T21:09:49.573 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:49 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service - Ceph mon.a for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:09:49.573 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:49 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a[31755]: 2026-02-19T21:09:49.451+0000 7f561e6996c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:09:49.573 INFO:journalctl@ceph.mon.a.trial090.stdout:Feb 19 21:09:49 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-a[31755]: 2026-02-19T21:09:49.451+0000 7f561e6996c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-19T21:09:49.668 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.a.service' 2026-02-19T21:09:49.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:49.718 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-19T21:09:49.719 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-19T21:09:49.719 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.b 2026-02-19T21:09:50.055 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:49 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.b.service - Ceph mon.b for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:09:50.056 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-b[33879]: 2026-02-19T21:09:49.832+0000 7fd5fb1ce6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:09:50.056 INFO:journalctl@ceph.mon.b.trial105.stdout:Feb 19 21:09:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-b[33879]: 2026-02-19T21:09:49.832+0000 7fd5fb1ce6c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-19T21:09:50.129 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.b.service' 2026-02-19T21:09:50.177 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:50.177 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-19T21:09:50.177 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-19T21:09:50.177 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.c 2026-02-19T21:09:50.456 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:50 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.c.service - Ceph mon.c for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:09:50.456 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-c[34112]: 2026-02-19T21:09:50.284+0000 7f8d5f3cd6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:09:50.456 INFO:journalctl@ceph.mon.c.trial175.stdout:Feb 19 21:09:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mon-c[34112]: 2026-02-19T21:09:50.284+0000 7f8d5f3cd6c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-19T21:09:50.552 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mon.c.service' 2026-02-19T21:09:50.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:50.601 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-19T21:09:50.601 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-19T21:09:50.602 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x 2026-02-19T21:09:50.825 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.x.service' 2026-02-19T21:09:50.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:50.870 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-19T21:09:50.871 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-19T21:09:50.871 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.y 2026-02-19T21:09:50.988 INFO:journalctl@ceph.mgr.y.trial105.stdout:Feb 19 21:09:50 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.y.service - Ceph mgr.y for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:09:51.086 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.y.service' 2026-02-19T21:09:51.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:51.131 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-19T21:09:51.131 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-19T21:09:51.132 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.z 2026-02-19T21:09:51.330 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mgr.z.service' 2026-02-19T21:09:51.376 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:51.376 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-19T21:09:51.376 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-19T21:09:51.376 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.0 2026-02-19T21:09:51.656 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:51 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.0.service - Ceph osd.0 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:09:51.656 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:51 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0[45984]: 2026-02-19T21:09:51.475+0000 7f80bd86b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:09:51.656 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:51 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0[45984]: 2026-02-19T21:09:51.475+0000 7f80bd86b6c0 -1 osd.0 77 *** Got signal Terminated *** 2026-02-19T21:09:51.657 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:51 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0[45984]: 2026-02-19T21:09:51.475+0000 7f80bd86b6c0 -1 osd.0 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:09:56.864 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89451]: 2026-02-19 21:09:56.545269783 +0000 UTC m=+5.080766996 container died c4a16482b0443ea91fbd92f0787ce00dbefddad400852409b668a862ed68bd2a (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, OSD_FLAVOR=default) 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89451]: 2026-02-19 21:09:56.553047891 +0000 UTC m=+5.088545114 container remove c4a16482b0443ea91fbd92f0787ce00dbefddad400852409b668a862ed68bd2a (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.41.3, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10) 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 bash[89451]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89578]: 2026-02-19 21:09:56.697041319 +0000 UTC m=+0.015419553 container create 95648903d21addee4bb6b95dc24428baa19060dd5fa49655ea0f52907ddcaf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89578]: 2026-02-19 21:09:56.730936218 +0000 UTC m=+0.049314443 container init 95648903d21addee4bb6b95dc24428baa19060dd5fa49655ea0f52907ddcaf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image) 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89578]: 2026-02-19 21:09:56.732827431 +0000 UTC m=+0.051205665 container start 95648903d21addee4bb6b95dc24428baa19060dd5fa49655ea0f52907ddcaf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, vendor=Rocky Enterprise Software Foundation, version=10) 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89578]: 2026-02-19 21:09:56.733274161 +0000 UTC m=+0.051652395 container attach 95648903d21addee4bb6b95dc24428baa19060dd5fa49655ea0f52907ddcaf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, ceph=True, license=BSD-3-Clause, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89578]: 2026-02-19 21:09:56.690785028 +0000 UTC m=+0.009163262 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:09:56.865 INFO:journalctl@ceph.osd.0.trial090.stdout:Feb 19 21:09:56 trial090 podman[89578]: 2026-02-19 21:09:56.863984516 +0000 UTC m=+0.182362750 container died 95648903d21addee4bb6b95dc24428baa19060dd5fa49655ea0f52907ddcaf85 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, io.buildah.version=1.41.3) 2026-02-19T21:09:56.897 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.0.service' 2026-02-19T21:09:56.944 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:09:56.944 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-19T21:09:56.945 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-19T21:09:56.945 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.1 2026-02-19T21:09:57.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:09:56 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.1.service - Ceph osd.1 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:09:57.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:09:57 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1[39752]: 2026-02-19T21:09:57.047+0000 7efca919f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:09:57.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:09:57 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1[39752]: 2026-02-19T21:09:57.047+0000 7efca919f6c0 -1 osd.1 77 *** Got signal Terminated *** 2026-02-19T21:09:57.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:09:57 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1[39752]: 2026-02-19T21:09:57.047+0000 7efca919f6c0 -1 osd.1 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[65968]: 2026-02-19 21:10:02.127336112 +0000 UTC m=+5.091743367 container died ae36a2594963b611a0888bbf591d69e437f4b4cef8548adaf7bfb4839e57b778 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, summary=Rocky Linux Base image, license=BSD-3-Clause, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[65968]: 2026-02-19 21:10:02.135931407 +0000 UTC m=+5.100338672 container remove ae36a2594963b611a0888bbf591d69e437f4b4cef8548adaf7bfb4839e57b778 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, org.opencontainers.image.version=10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3) 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 bash[65968]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[66099]: 2026-02-19 21:10:02.275176372 +0000 UTC m=+0.015364454 container create 69bddc6f62c1a185ec524244fb91882fc85f683da94f5598cf506eb383ab99df (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.version=10, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.41.3, version=10) 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[66099]: 2026-02-19 21:10:02.313704415 +0000 UTC m=+0.053892497 container init 69bddc6f62c1a185ec524244fb91882fc85f683da94f5598cf506eb383ab99df (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, ceph=True, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, version=10) 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[66099]: 2026-02-19 21:10:02.315787249 +0000 UTC m=+0.055975331 container start 69bddc6f62c1a185ec524244fb91882fc85f683da94f5598cf506eb383ab99df (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1-deactivate, io.buildah.version=1.41.3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, ceph=True, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[66099]: 2026-02-19 21:10:02.316243526 +0000 UTC m=+0.056431618 container attach 69bddc6f62c1a185ec524244fb91882fc85f683da94f5598cf506eb383ab99df (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-1-deactivate, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, version=10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux) 2026-02-19T21:10:02.395 INFO:journalctl@ceph.osd.1.trial105.stdout:Feb 19 21:10:02 trial105 podman[66099]: 2026-02-19 21:10:02.268823396 +0000 UTC m=+0.009011498 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:02.482 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.1.service' 2026-02-19T21:10:02.529 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:02.529 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-19T21:10:02.529 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-19T21:10:02.530 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.2 2026-02-19T21:10:03.016 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:02 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.2.service - Ceph osd.2 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:03.016 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:02 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2[40458]: 2026-02-19T21:10:02.651+0000 7f6e315f66c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:03.016 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:02 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2[40458]: 2026-02-19T21:10:02.651+0000 7f6e315f66c0 -1 osd.2 77 *** Got signal Terminated *** 2026-02-19T21:10:03.016 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:02 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2[40458]: 2026-02-19T21:10:02.651+0000 7f6e315f66c0 -1 osd.2 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:08.016 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68415]: 2026-02-19 21:10:07.721129057 +0000 UTC m=+5.081349514 container died 27a42b4ef2374148ffd3c2af2ba6d7461656ce6a2d4d8e8e7bfe95cd90407879 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, version=10, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, name=rockylinux, OSD_FLAVOR=default) 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68415]: 2026-02-19 21:10:07.729406693 +0000 UTC m=+5.089627151 container remove 27a42b4ef2374148ffd3c2af2ba6d7461656ce6a2d4d8e8e7bfe95cd90407879 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 bash[68415]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68542]: 2026-02-19 21:10:07.865508902 +0000 UTC m=+0.016642175 container create 81f5d411d38c44f1c2a9a694c40c7e613d08061d128be14c8162174486595989 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2-deactivate, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68542]: 2026-02-19 21:10:07.905138013 +0000 UTC m=+0.056271286 container init 81f5d411d38c44f1c2a9a694c40c7e613d08061d128be14c8162174486595989 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, ceph=True, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.41.3, org.opencontainers.image.version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause) 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68542]: 2026-02-19 21:10:07.907016288 +0000 UTC m=+0.058149561 container start 81f5d411d38c44f1c2a9a694c40c7e613d08061d128be14c8162174486595989 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, OSD_FLAVOR=default, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, ceph=True, name=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68542]: 2026-02-19 21:10:07.907517257 +0000 UTC m=+0.058650540 container attach 81f5d411d38c44f1c2a9a694c40c7e613d08061d128be14c8162174486595989 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-2-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image) 2026-02-19T21:10:08.017 INFO:journalctl@ceph.osd.2.trial175.stdout:Feb 19 21:10:07 trial175 podman[68542]: 2026-02-19 21:10:07.858807881 +0000 UTC m=+0.009941174 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:08.079 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.2.service' 2026-02-19T21:10:08.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:08.127 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-19T21:10:08.127 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-19T21:10:08.127 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.3 2026-02-19T21:10:08.406 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:08 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.3.service - Ceph osd.3 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:08.406 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:08 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3[52144]: 2026-02-19T21:10:08.233+0000 7fe5a297e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:08.406 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:08 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3[52144]: 2026-02-19T21:10:08.233+0000 7fe5a297e6c0 -1 osd.3 77 *** Got signal Terminated *** 2026-02-19T21:10:08.407 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:08 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3[52144]: 2026-02-19T21:10:08.233+0000 7fe5a297e6c0 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:13.627 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89726]: 2026-02-19 21:10:13.323704383 +0000 UTC m=+5.101972260 container died ef2d85c689135c1505c68c22944f9710079ba377d401270a18da12752bee27ea (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3, name=rockylinux, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:10:13.627 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89726]: 2026-02-19 21:10:13.332175197 +0000 UTC m=+5.110443075 container remove ef2d85c689135c1505c68c22944f9710079ba377d401270a18da12752bee27ea (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3, org.opencontainers.image.title=rockylinux, io.buildah.version=1.41.3, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-19T21:10:13.627 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 bash[89726]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3 2026-02-19T21:10:13.628 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89850]: 2026-02-19 21:10:13.464736501 +0000 UTC m=+0.014886132 container create 8753e2c2708de3fbea4e50b19ddd0e38dd469547d41c388059a686d466889a52 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3-deactivate, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, version=10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3) 2026-02-19T21:10:13.628 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89850]: 2026-02-19 21:10:13.495884578 +0000 UTC m=+0.046034209 container init 8753e2c2708de3fbea4e50b19ddd0e38dd469547d41c388059a686d466889a52 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:10:13.628 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89850]: 2026-02-19 21:10:13.497885525 +0000 UTC m=+0.048035166 container start 8753e2c2708de3fbea4e50b19ddd0e38dd469547d41c388059a686d466889a52 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.version=10, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-19T21:10:13.628 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89850]: 2026-02-19 21:10:13.498349236 +0000 UTC m=+0.048498877 container attach 8753e2c2708de3fbea4e50b19ddd0e38dd469547d41c388059a686d466889a52 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3-deactivate, version=10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause) 2026-02-19T21:10:13.628 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89850]: 2026-02-19 21:10:13.458570718 +0000 UTC m=+0.008720349 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:13.628 INFO:journalctl@ceph.osd.3.trial090.stdout:Feb 19 21:10:13 trial090 podman[89850]: 2026-02-19 21:10:13.626675252 +0000 UTC m=+0.176824893 container died 8753e2c2708de3fbea4e50b19ddd0e38dd469547d41c388059a686d466889a52 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-3-deactivate, ceph=True, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-19T21:10:13.657 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.3.service' 2026-02-19T21:10:13.704 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:13.704 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-19T21:10:13.704 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-19T21:10:13.705 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.4 2026-02-19T21:10:14.145 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:13 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.4.service - Ceph osd.4 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:14.145 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:13 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4[45852]: 2026-02-19T21:10:13.811+0000 7feaf5f556c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:14.145 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:13 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4[45852]: 2026-02-19T21:10:13.811+0000 7feaf5f556c0 -1 osd.4 77 *** Got signal Terminated *** 2026-02-19T21:10:14.145 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:13 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4[45852]: 2026-02-19T21:10:13.811+0000 7feaf5f556c0 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:17.256 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:16 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:16.971+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:17.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:17 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:17.256+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:17.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:17 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:17.179+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:18.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:17 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:17.937+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:18.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:18 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:18.365+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:18.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:18 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:18.205+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:18.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:18 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:18.289+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:18 trial105 podman[66241]: 2026-02-19 21:10:18.880720507 +0000 UTC m=+5.080125796 container died 82b237e3080840ee7aea1fb15657ea6e704fb2a9f75c55150ac15bacec25369c (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4, OSD_FLAVOR=default, license=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, io.buildah.version=1.41.3, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:18 trial105 podman[66241]: 2026-02-19 21:10:18.889085114 +0000 UTC m=+5.088490403 container remove 82b237e3080840ee7aea1fb15657ea6e704fb2a9f75c55150ac15bacec25369c (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.41.3) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:18 trial105 bash[66241]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:19 trial105 podman[66367]: 2026-02-19 21:10:19.028402573 +0000 UTC m=+0.015738127 container create ec45dcc20f7ecc65cc1c48057cedd30138c198c5d166474c3d6db6c92a9ac06f (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4-deactivate, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, version=10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:19 trial105 podman[66367]: 2026-02-19 21:10:19.052501098 +0000 UTC m=+0.039836672 container init ec45dcc20f7ecc65cc1c48057cedd30138c198c5d166474c3d6db6c92a9ac06f (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4-deactivate, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:19 trial105 podman[66367]: 2026-02-19 21:10:19.054580275 +0000 UTC m=+0.041915839 container start ec45dcc20f7ecc65cc1c48057cedd30138c198c5d166474c3d6db6c92a9ac06f (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4-deactivate, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:19 trial105 podman[66367]: 2026-02-19 21:10:19.054979726 +0000 UTC m=+0.042315310 container attach ec45dcc20f7ecc65cc1c48057cedd30138c198c5d166474c3d6db6c92a9ac06f (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-4-deactivate, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, summary=Rocky Linux Base image) 2026-02-19T21:10:19.146 INFO:journalctl@ceph.osd.4.trial105.stdout:Feb 19 21:10:19 trial105 podman[66367]: 2026-02-19 21:10:19.021958298 +0000 UTC m=+0.009293852 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:19.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:18 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:18.816+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:19.229 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.4.service' 2026-02-19T21:10:19.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:18 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:18.980+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:19.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:19.276 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-19T21:10:19.276 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-19T21:10:19.277 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.5 2026-02-19T21:10:19.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:19 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:19.332+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:19.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:19 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:19.230+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:19.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:19 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:19.274+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:19.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:19 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.5.service - Ceph osd.5 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:19.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:19 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:19.385+0000 7f25c851d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:19.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:19 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:19.385+0000 7f25c851d6c0 -1 osd.5 77 *** Got signal Terminated *** 2026-02-19T21:10:19.767 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:19 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:19.385+0000 7f25c851d6c0 -1 osd.5 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:20.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:19 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:19.797+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:20.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:19 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:19.949+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:20.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:20 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:20.336+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:20.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:20 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:20.191+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:20.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:20 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:20.373+0000 7f25c03ea6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:54.176663+0000 front 2026-02-19T21:09:54.176712+0000 (oldest deadline 2026-02-19T21:10:19.476712+0000) 2026-02-19T21:10:20.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:20 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:20.287+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:21.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:20 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:20.785+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:21.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:20 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:20.933+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:21.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:21 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:21.304+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:21.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:21 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:21.240+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:21.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:21 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:21.415+0000 7f25c03ea6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:54.176663+0000 front 2026-02-19T21:09:54.176712+0000 (oldest deadline 2026-02-19T21:10:19.476712+0000) 2026-02-19T21:10:21.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:21 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:21.308+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:22.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:21 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:21.809+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:22.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:21 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:21.945+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:22.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:22 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:22.343+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:22.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:22 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:22.258+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:22.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:22 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:22.377+0000 7f25c03ea6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:54.176663+0000 front 2026-02-19T21:09:54.176712+0000 (oldest deadline 2026-02-19T21:10:19.476712+0000) 2026-02-19T21:10:22.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:22 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:22.320+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:23.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:22 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:22.852+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:23.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:22 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:22.852+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:23.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:22 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:22.910+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:23.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:23 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:23.308+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:23.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:23 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:23.264+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:23.766 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:23 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:23.342+0000 7f25c03ea6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:54.176663+0000 front 2026-02-19T21:09:54.176712+0000 (oldest deadline 2026-02-19T21:10:19.476712+0000) 2026-02-19T21:10:23.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:23 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:23.370+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:24.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:23 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:23.855+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:24.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:23 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:23.855+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:24.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:23 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:23.927+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:24.618 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:24 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:24.365+0000 7f25c03ea6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:54.176663+0000 front 2026-02-19T21:09:54.176712+0000 (oldest deadline 2026-02-19T21:10:19.476712+0000) 2026-02-19T21:10:24.619 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:24 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5[46864]: 2026-02-19T21:10:24.365+0000 7f25c03ea6c0 -1 osd.5 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:59.476905+0000 front 2026-02-19T21:09:59.477025+0000 (oldest deadline 2026-02-19T21:10:24.176993+0000) 2026-02-19T21:10:24.619 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:24 trial175 podman[68678]: 2026-02-19 21:10:24.454889643 +0000 UTC m=+5.081758739 container died 417b59b6ac475745532e416fb57a53c27c249840aa67dc90613889957f0a9cac (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5, ceph=True, name=rockylinux, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, license=BSD-3-Clause, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-19T21:10:24.619 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:24 trial175 podman[68678]: 2026-02-19 21:10:24.462645041 +0000 UTC m=+5.089514127 container remove 417b59b6ac475745532e416fb57a53c27c249840aa67dc90613889957f0a9cac (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.41.3) 2026-02-19T21:10:24.619 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:24 trial175 bash[68678]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5 2026-02-19T21:10:24.619 INFO:journalctl@ceph.osd.5.trial175.stdout:Feb 19 21:10:24 trial175 podman[68805]: 2026-02-19 21:10:24.593019985 +0000 UTC m=+0.015860015 container create 8b94a20695c613598812ba4b4d66eac00c08e951a44b11f05c0d4e00d1fd7770 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-5-deactivate, license=BSD-3-Clause, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, io.buildah.version=1.41.3, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T21:10:24.619 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:24 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:24.353+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:24.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:24 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:24.319+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:24.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:24 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:24.319+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:24.645 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:24 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:24.526+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:24.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:24.218+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:24.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:24.218+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:24.793 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.5.service' 2026-02-19T21:10:24.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:24.841 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-19T21:10:24.841 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-19T21:10:24.841 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.6 2026-02-19T21:10:25.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:24.856+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:25.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:24.856+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:25.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:24 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.6.service - Ceph osd.6 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:25.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:24.950+0000 7f9c35d926c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:25.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:24.950+0000 7f9c35d926c0 -1 osd.6 77 *** Got signal Terminated *** 2026-02-19T21:10:25.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:24 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:24.950+0000 7f9c35d926c0 -1 osd.6 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:25.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:24 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:24.935+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:25.539 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:25 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:25.279+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:25.539 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:25 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:25.279+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:25.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:25 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:25.178+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:25.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:25 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:25.178+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:25.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:25 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:25.398+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:25.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:25 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:25.538+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:26.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:25 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:25.894+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:26.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:25 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:25.894+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:26.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:25 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:25.911+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:26.572 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:26 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:26.303+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:26.572 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:26 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:26.303+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:26.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:26 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:26.206+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:26.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:26 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:26.206+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:26.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:26 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:26.358+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:26.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:26 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:26.358+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:26.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:26 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:26.571+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:27.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:26 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:26.868+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:27.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:26 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:26.868+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:27.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:26 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:26.916+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:27.568 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:27 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:27.273+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:27.569 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:27 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:27.273+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:27.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:27 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:27.226+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:27.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:27 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:27.226+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:27.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:27 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:27.346+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:27.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:27 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:27.346+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:27.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:27 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:27.568+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:28.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:27 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:27.831+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:28.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:27 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:27.831+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:28.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:27 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:27.914+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:28.597 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:28 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:28.234+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:28.598 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:28 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:28.234+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:28.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:28 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:28.244+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:28.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:28 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:28.244+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:28.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:28 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:28.376+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:28.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:28 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:28.376+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:28.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:28 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:28.597+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:29.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:28 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:28.856+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:29.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:28 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:28.856+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:29.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:28 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:28.856+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.868509+0000 front 2026-02-19T21:10:06.868593+0000 (oldest deadline 2026-02-19T21:10:27.968453+0000) 2026-02-19T21:10:29.265 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:28 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:28.891+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:29.591 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:29 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:29.264+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:29.591 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:29 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:29.265+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:29.591 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:29 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:29.265+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:29.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:29 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:29.244+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:29.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:29 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:29.244+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:29.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:29 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:29.410+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:29.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:29 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:29.410+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:29.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:29 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:29.590+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:29.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:29 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:29.590+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.678066+0000 front 2026-02-19T21:10:06.678050+0000 (oldest deadline 2026-02-19T21:10:29.578055+0000) 2026-02-19T21:10:30.156 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:29 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:29.838+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.767744+0000 front 2026-02-19T21:09:52.767754+0000 (oldest deadline 2026-02-19T21:10:18.067794+0000) 2026-02-19T21:10:30.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:29 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:29.838+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.068018+0000 front 2026-02-19T21:09:58.068044+0000 (oldest deadline 2026-02-19T21:10:22.168044+0000) 2026-02-19T21:10:30.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:29 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6[58578]: 2026-02-19T21:10:29.838+0000 7f9c2dc5f6c0 -1 osd.6 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.868509+0000 front 2026-02-19T21:10:06.868593+0000 (oldest deadline 2026-02-19T21:10:27.968453+0000) 2026-02-19T21:10:30.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:30 trial090 podman[89987]: 2026-02-19 21:10:30.029752795 +0000 UTC m=+5.090561110 container died 33b601400e67eff1b65031138ca908802a5216aaef3a47b4b7937faf7d6087e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, summary=Rocky Linux Base image, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55) 2026-02-19T21:10:30.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:30 trial090 podman[89987]: 2026-02-19 21:10:30.037298111 +0000 UTC m=+5.098106426 container remove 33b601400e67eff1b65031138ca908802a5216aaef3a47b4b7937faf7d6087e2 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10) 2026-02-19T21:10:30.157 INFO:journalctl@ceph.osd.6.trial090.stdout:Feb 19 21:10:30 trial090 bash[89987]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-6 2026-02-19T21:10:30.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:29 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:29.846+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:30.366 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.6.service' 2026-02-19T21:10:30.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:30.413 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-19T21:10:30.413 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-19T21:10:30.413 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.7 2026-02-19T21:10:30.526 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:30 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.7.service - Ceph osd.7 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:30.527 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:30.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:30.527 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:30.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:30.527 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:30.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:30.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:30 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:30.203+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:30.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:30 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:30.203+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:30.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:30.401+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:30.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:30.401+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:30.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:30.401+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:30.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:30.525+0000 7efe4135c6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:30.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:30.525+0000 7efe4135c6c0 -1 osd.7 77 *** Got signal Terminated *** 2026-02-19T21:10:30.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:30.525+0000 7efe4135c6c0 -1 osd.7 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:30.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:30.630+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:30.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:30 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:30.630+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.678066+0000 front 2026-02-19T21:10:06.678050+0000 (oldest deadline 2026-02-19T21:10:29.578055+0000) 2026-02-19T21:10:31.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:30.797+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:31.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:30 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:30.797+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:31.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:31 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:31.275+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:31.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:31 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:31.275+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:31.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:31 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:31.275+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:31.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:31 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:31.237+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:31.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:31 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:31.237+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:31.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:31 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:31.373+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:31.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:31 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:31.373+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:31.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:31 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:31.373+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:32.145 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:31 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:31.650+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:32.145 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:31 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:31.650+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.678066+0000 front 2026-02-19T21:10:06.678050+0000 (oldest deadline 2026-02-19T21:10:29.578055+0000) 2026-02-19T21:10:32.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:31 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:31.826+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:32.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:31 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:31.826+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:32.611 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:32 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:32.249+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:32.611 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:32 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:32.249+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:32.611 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:32 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:32.249+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:32.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:32 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:32.286+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:32.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:32 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:32.286+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:32.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:32 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:32.286+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:32.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:32 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:32.341+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:32.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:32 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:32.341+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:32.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:32 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:32.341+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:32.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:32 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:32.609+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:32.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:32 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:32.609+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.678066+0000 front 2026-02-19T21:10:06.678050+0000 (oldest deadline 2026-02-19T21:10:29.578055+0000) 2026-02-19T21:10:33.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:32 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:32.797+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:33.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:32 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:32.797+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:33.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:33 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:33.278+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:33.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:33 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:33.278+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:33.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:33 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:33.278+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:33.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:33 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:33.285+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:33.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:33 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:33.285+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:33.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:33 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:33.285+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:33.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:33 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:33.336+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:33.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:33 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:33.336+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:33.766 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:33 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:33.336+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:34.145 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:33 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:33.649+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:34.145 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:33 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:33.649+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.678066+0000 front 2026-02-19T21:10:06.678050+0000 (oldest deadline 2026-02-19T21:10:29.578055+0000) 2026-02-19T21:10:34.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:33 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:33.772+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:34.266 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:33 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:33.772+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:34.625 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:34 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:34.275+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:34.625 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:34 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:34.275+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:34.625 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:34 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:34.275+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:34.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:34 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:34.279+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:34.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:34 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:34.279+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:34.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:34 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:34.279+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:34.723 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:34 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:34.294+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:34.723 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:34 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:34.294+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:34.724 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:34 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:34.294+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:34.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:34 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:34.625+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.877596+0000 front 2026-02-19T21:10:00.877567+0000 (oldest deadline 2026-02-19T21:10:23.777658+0000) 2026-02-19T21:10:34.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:34 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:34.625+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.678066+0000 front 2026-02-19T21:10:06.678050+0000 (oldest deadline 2026-02-19T21:10:29.578055+0000) 2026-02-19T21:10:34.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:34 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7[52165]: 2026-02-19T21:10:34.625+0000 7efe3d2316c0 -1 osd.7 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:09.578255+0000 front 2026-02-19T21:10:09.578278+0000 (oldest deadline 2026-02-19T21:10:33.678268+0000) 2026-02-19T21:10:35.016 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:34 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:34.723+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:35.016 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:34 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:34.723+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:35.605 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:35 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:35.322+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:35.606 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:35 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:35.322+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:35.606 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:35 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:35.322+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:35.606 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:35 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:35.322+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:35.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:35 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:35.302+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:35.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:35 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:35.302+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:35.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:35 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:35.302+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:35.736 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:35 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:35.282+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:35.736 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:35 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:35.282+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:35.736 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:35 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:35.282+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66508]: 2026-02-19 21:10:35.605399532 +0000 UTC m=+5.090512500 container died f05affd9d539e1960103824d9c7f295ec0fd49920824f35829cc68c05da3e4e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.41.3, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.version=10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66508]: 2026-02-19 21:10:35.613598461 +0000 UTC m=+5.098711439 container remove f05affd9d539e1960103824d9c7f295ec0fd49920824f35829cc68c05da3e4e1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 bash[66508]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66636]: 2026-02-19 21:10:35.75322327 +0000 UTC m=+0.015207633 container create e594a8b6ef4ccc8df85542269ad6a263da70e04d4b5d740049b618ae43689277 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7-deactivate, name=rockylinux, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, version=10, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66636]: 2026-02-19 21:10:35.789393169 +0000 UTC m=+0.051377532 container init e594a8b6ef4ccc8df85542269ad6a263da70e04d4b5d740049b618ae43689277 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66636]: 2026-02-19 21:10:35.791403789 +0000 UTC m=+0.053388152 container start e594a8b6ef4ccc8df85542269ad6a263da70e04d4b5d740049b618ae43689277 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66636]: 2026-02-19 21:10:35.79190043 +0000 UTC m=+0.053884793 container attach e594a8b6ef4ccc8df85542269ad6a263da70e04d4b5d740049b618ae43689277 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-7-deactivate, io.buildah.version=1.41.3, version=10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, name=rockylinux) 2026-02-19T21:10:35.895 INFO:journalctl@ceph.osd.7.trial105.stdout:Feb 19 21:10:35 trial105 podman[66636]: 2026-02-19 21:10:35.746874052 +0000 UTC m=+0.008858415 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:35.950 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.7.service' 2026-02-19T21:10:35.997 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:35.997 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-19T21:10:35.997 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-19T21:10:35.997 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.8 2026-02-19T21:10:36.016 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:35 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:35.735+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:36.016 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:35 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:35.735+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:36.300 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:36.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:36.300 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:36.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:36.300 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:36.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:36.300 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:36 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:36.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:36.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:36.234+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:36.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:36.234+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:36.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:36.234+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:36.517 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:36 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.8.service - Ceph osd.8 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:36.517 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:36.100+0000 7ff3b6de76c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:36.517 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:36.100+0000 7ff3b6de76c0 -1 osd.8 77 *** Got signal Terminated *** 2026-02-19T21:10:36.517 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:36.100+0000 7ff3b6de76c0 -1 osd.8 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:36.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:36 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:36.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:36.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:36 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:36.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:36.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:36 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:36.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:37.015 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:36.734+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:37.016 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:36 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:36.734+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:37.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:37 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:37.191+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:37.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:37 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:37.191+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:37.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:37 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:37.191+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:37.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:37 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:37.283+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:37.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:37 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:37.283+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:37.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:37 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:37.283+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:37.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:37 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:37.283+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:37.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:37 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:37.358+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:37.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:37 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:37.358+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:37.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:37 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:37.358+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:38.184 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:37 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:37.769+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:38.184 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:37 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:37.769+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:38.184 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:37 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:37.769+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:12.748581+0000 front 2026-02-19T21:10:12.748557+0000 (oldest deadline 2026-02-19T21:10:37.448494+0000) 2026-02-19T21:10:38.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:38 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:38.184+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:38.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:38 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:38.184+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:38.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:38 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:38.184+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:38.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:38 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:38.330+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:38.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:38 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:38.330+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:38.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:38 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:38.330+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:38.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:38 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:38.330+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:38.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:38 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:38.311+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:38.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:38 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:38.311+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:38.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:38 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:38.311+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:38.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:38 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:38.311+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:39.158 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:38 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:38.792+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:39.159 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:38 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:38.792+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:39.159 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:38 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:38.792+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:12.748581+0000 front 2026-02-19T21:10:12.748557+0000 (oldest deadline 2026-02-19T21:10:37.448494+0000) 2026-02-19T21:10:39.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:39.159+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:39.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:39.159+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:39.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:39.159+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:39.644 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:39 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:39.345+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:39.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:39 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:39.345+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:39.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:39 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:39.345+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:39.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:39 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:39.345+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:39.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:39 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:39.350+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:39.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:39 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:39.350+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:39.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:39 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:39.350+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:39.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:39 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:39.350+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:40.152 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:39.842+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:40.152 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:39.842+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:40.152 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:39.842+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:12.748581+0000 front 2026-02-19T21:10:12.748557+0000 (oldest deadline 2026-02-19T21:10:37.448494+0000) 2026-02-19T21:10:40.152 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:39 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:39.842+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:17.948920+0000 front 2026-02-19T21:10:17.948965+0000 (oldest deadline 2026-02-19T21:10:39.048898+0000) 2026-02-19T21:10:40.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:40.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:40.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:40.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:40.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:40.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:40.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:40.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:40.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:40 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:40.353+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:40.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:40 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:40.353+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:40.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:40 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:40.353+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:40.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:40 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:40.353+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:40.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:40 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:40.353+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:40.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:40.364+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:40.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:40.364+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:40.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:40.364+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:40.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:40 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:40.364+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:41.170 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:40.881+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.046911+0000 front 2026-02-19T21:09:53.047033+0000 (oldest deadline 2026-02-19T21:10:16.546963+0000) 2026-02-19T21:10:41.170 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:40.881+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:05.747898+0000 front 2026-02-19T21:10:05.748014+0000 (oldest deadline 2026-02-19T21:10:29.848001+0000) 2026-02-19T21:10:41.170 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:40.881+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:12.748581+0000 front 2026-02-19T21:10:12.748557+0000 (oldest deadline 2026-02-19T21:10:37.448494+0000) 2026-02-19T21:10:41.171 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:40 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8[53370]: 2026-02-19T21:10:40.881+0000 7ff3aecb46c0 -1 osd.8 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:17.948920+0000 front 2026-02-19T21:10:17.948965+0000 (oldest deadline 2026-02-19T21:10:39.048898+0000) 2026-02-19T21:10:41.470 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[68940]: 2026-02-19 21:10:41.170792824 +0000 UTC m=+5.081341877 container died e53d3f5595d589f40b049e2f361bc3eb981be1133c09dfba4b74f348ca69bc53 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8, io.buildah.version=1.41.3, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, version=10, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:10:41.470 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[68940]: 2026-02-19 21:10:41.179146402 +0000 UTC m=+5.089695465 container remove e53d3f5595d589f40b049e2f361bc3eb981be1133c09dfba4b74f348ca69bc53 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, io.buildah.version=1.41.3, license=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True) 2026-02-19T21:10:41.471 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 bash[68940]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8 2026-02-19T21:10:41.471 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[69069]: 2026-02-19 21:10:41.313553867 +0000 UTC m=+0.015677757 container create 67c86d68549c497decff3e98a0dd4eac5041b4de94d90064e4c70d810f0012f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8-deactivate, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, io.buildah.version=1.41.3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T21:10:41.471 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:41 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:41.196+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:41.471 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:41 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:41.196+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:41.471 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:41 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:41.196+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:41.472 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:41 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:41.196+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:41.472 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[69069]: 2026-02-19 21:10:41.344704698 +0000 UTC m=+0.046828598 container init 67c86d68549c497decff3e98a0dd4eac5041b4de94d90064e4c70d810f0012f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8-deactivate, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:10:41.472 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[69069]: 2026-02-19 21:10:41.346756455 +0000 UTC m=+0.048880355 container start 67c86d68549c497decff3e98a0dd4eac5041b4de94d90064e4c70d810f0012f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8-deactivate, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause) 2026-02-19T21:10:41.472 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[69069]: 2026-02-19 21:10:41.347163359 +0000 UTC m=+0.049287269 container attach 67c86d68549c497decff3e98a0dd4eac5041b4de94d90064e4c70d810f0012f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8-deactivate, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.version=10, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55) 2026-02-19T21:10:41.472 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[69069]: 2026-02-19 21:10:41.306892218 +0000 UTC m=+0.009016118 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:41.472 INFO:journalctl@ceph.osd.8.trial175.stdout:Feb 19 21:10:41 trial175 podman[69069]: 2026-02-19 21:10:41.47060487 +0000 UTC m=+0.172728770 container died 67c86d68549c497decff3e98a0dd4eac5041b4de94d90064e4c70d810f0012f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-8-deactivate, version=10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause) 2026-02-19T21:10:41.508 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.8.service' 2026-02-19T21:10:41.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:41.596 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-19T21:10:41.596 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-19T21:10:41.596 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.9 2026-02-19T21:10:41.644 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.380+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:41.644 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.380+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:41.644 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.380+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:41.644 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.380+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:41.644 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.9.service - Ceph osd.9 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:41.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:41 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:41.377+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:41.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:41 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:41.377+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:41.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:41 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:41.377+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:41.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:41 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:41.378+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:41.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:41 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:41.378+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:42.156 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.701+0000 7fecace4b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:42.156 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.701+0000 7fecace4b6c0 -1 osd.9 77 *** Got signal Terminated *** 2026-02-19T21:10:42.156 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:41 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:41.701+0000 7fecace4b6c0 -1 osd.9 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:42.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:42 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:42.218+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:42.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:42 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:42.218+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:42.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:42 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:42.218+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:42.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:42 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:42.218+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:42.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:42 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:42.335+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:42.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:42 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:42.335+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:42.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:42 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:42.335+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:42.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:42 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:42.335+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:42.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:42 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:42.335+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:42.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:42 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:42.334+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:42.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:42 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:42.334+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:42.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:42 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:42.334+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:42.657 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:42 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:42.334+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:43.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:43.194+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:43.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:43.194+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:43.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:43.194+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:43.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:43 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:43.194+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:43.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:43 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:43.312+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:43.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:43 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:43.312+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:43.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:43 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:43.312+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:43.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:43 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:43.312+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:43.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:43 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:43.312+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:43.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:43 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:43.308+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:43.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:43 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:43.308+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:43.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:43 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:43.308+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:43.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:43 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:43.308+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:44.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:44.210+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:44.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:44.210+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:44.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:44.210+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:44.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:44 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:44.210+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:44.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:44.309+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:44.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:44.309+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:44.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:44.309+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:44.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:44.309+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:44.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:44 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:44.309+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:44.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:44 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:44.328+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:44.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:44 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:44.328+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:44.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:44 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:44.328+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:44.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:44 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:44.328+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:44.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:44 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:44.328+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:18.388521+0000 front 2026-02-19T21:10:18.388506+0000 (oldest deadline 2026-02-19T21:10:43.688584+0000) 2026-02-19T21:10:45.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:45 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:45.189+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:45.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:45 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:45.189+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:45.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:45 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:45.189+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:45.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:45 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:45.189+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:45.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:45 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:45.325+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:45.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:45 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:45.325+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:45.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:45 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:45.325+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:45.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:45 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:45.325+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:45.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:45 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:45.325+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:45.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:45 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:45.325+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:45.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:45 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:45.344+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:45.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:45 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:45.344+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:45.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:45 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:45.344+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:45.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:45 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:45.344+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:45.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:45 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:45.344+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:18.388521+0000 front 2026-02-19T21:10:18.388506+0000 (oldest deadline 2026-02-19T21:10:43.688584+0000) 2026-02-19T21:10:46.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:46 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:46.187+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:46.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:46 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:46.187+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:46.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:46 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:46.187+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:46.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:46 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:46.187+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:46.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:46 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:46.375+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:46.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:46 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:46.375+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:46.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:46 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:46.375+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:46.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:46 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:46.375+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:46.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:46 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:46.375+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:46.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:46 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:46.375+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:46.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:46.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.386410+0000 front 2026-02-19T21:09:53.386430+0000 (oldest deadline 2026-02-19T21:10:16.886532+0000) 2026-02-19T21:10:46.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:46.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:00.986917+0000 front 2026-02-19T21:10:00.986949+0000 (oldest deadline 2026-02-19T21:10:23.886970+0000) 2026-02-19T21:10:46.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:46.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:06.687833+0000 front 2026-02-19T21:10:06.687766+0000 (oldest deadline 2026-02-19T21:10:31.987854+0000) 2026-02-19T21:10:46.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:46.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:11.987989+0000 front 2026-02-19T21:10:11.987999+0000 (oldest deadline 2026-02-19T21:10:37.888096+0000) 2026-02-19T21:10:46.656 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9[65101]: 2026-02-19T21:10:46.347+0000 7feca4d186c0 -1 osd.9 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:18.388521+0000 front 2026-02-19T21:10:18.388506+0000 (oldest deadline 2026-02-19T21:10:43.688584+0000) 2026-02-19T21:10:47.096 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 podman[90257]: 2026-02-19 21:10:46.771259851 +0000 UTC m=+5.080361163 container died 04bb2794fb90d9e65449a90a038713e842c6cc619786522054ecf19036ffb353 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.41.3, org.opencontainers.image.version=10, ceph=True, name=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux) 2026-02-19T21:10:47.096 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 podman[90257]: 2026-02-19 21:10:46.779648963 +0000 UTC m=+5.088750275 container remove 04bb2794fb90d9e65449a90a038713e842c6cc619786522054ecf19036ffb353 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, name=rockylinux, summary=Rocky Linux Base image, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-19T21:10:47.096 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 bash[90257]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9 2026-02-19T21:10:47.096 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 podman[90384]: 2026-02-19 21:10:46.916700277 +0000 UTC m=+0.014018080 container create 12bb13f6e92668d1d036ffe759184ce139a63edeb3353197509dc1464e1ac17b (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9-deactivate, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause) 2026-02-19T21:10:47.096 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 podman[90384]: 2026-02-19 21:10:46.945341608 +0000 UTC m=+0.042659421 container init 12bb13f6e92668d1d036ffe759184ce139a63edeb3353197509dc1464e1ac17b (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause) 2026-02-19T21:10:47.097 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 podman[90384]: 2026-02-19 21:10:46.947102519 +0000 UTC m=+0.044420332 container start 12bb13f6e92668d1d036ffe759184ce139a63edeb3353197509dc1464e1ac17b (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.version=10, version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, io.buildah.version=1.41.3, OSD_FLAVOR=default) 2026-02-19T21:10:47.097 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:46 trial090 podman[90384]: 2026-02-19 21:10:46.947600233 +0000 UTC m=+0.044918056 container attach 12bb13f6e92668d1d036ffe759184ce139a63edeb3353197509dc1464e1ac17b (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, version=10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-19T21:10:47.097 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:47 trial090 podman[90384]: 2026-02-19 21:10:46.910949094 +0000 UTC m=+0.008266907 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:47.097 INFO:journalctl@ceph.osd.9.trial090.stdout:Feb 19 21:10:47 trial090 podman[90384]: 2026-02-19 21:10:47.095640178 +0000 UTC m=+0.192958001 container died 12bb13f6e92668d1d036ffe759184ce139a63edeb3353197509dc1464e1ac17b (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-9-deactivate, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, license=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, io.buildah.version=1.41.3, OSD_FLAVOR=default, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-19T21:10:47.125 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.9.service' 2026-02-19T21:10:47.172 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:47.173 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-19T21:10:47.173 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-19T21:10:47.173 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.10 2026-02-19T21:10:47.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:47 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:47.160+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:47.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:47 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:47.160+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:47.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:47 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:47.160+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:47.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:47 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:47.160+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:47.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.10.service - Ceph osd.10 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:47.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.274+0000 7fb4edb1c6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.274+0000 7fb4edb1c6c0 -1 osd.10 77 *** Got signal Terminated *** 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.274+0000 7fb4edb1c6c0 -1 osd.10 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.347+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.347+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.347+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.347+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.347+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:47.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:47 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:47.347+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:48.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:48 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:48.143+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:48.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:48 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:48.143+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:48.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:48 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:48.143+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:48.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:48 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:48.143+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:48.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:48 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:48.314+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:48.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:48 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:48.314+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:48.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:48 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:48.314+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:48.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:48 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:48.314+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:48.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:48 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:48.314+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:48.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:48 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:48.314+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:49.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:49 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:49.110+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:49.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:49 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:49.110+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:49.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:49 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:49.110+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:49.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:49 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:49.110+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:49.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:49.342+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:49.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:49.342+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:49.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:49.342+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:49.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:49.342+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:49.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:49.342+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:49.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:49 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:49.342+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:50.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:50.146+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:50.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:50.146+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:50.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:50.146+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:50.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:50.146+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:50.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:50 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:50.146+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:50.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:50 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:50.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:50.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:50 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:50.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:50.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:50 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:50.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:50.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:50 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:50.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:50.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:50 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:50.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:50.646 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:50 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:50.299+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:51.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:51 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:51.105+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:51.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:51 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:51.105+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:51.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:51 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:51.105+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:51.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:51 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:51.105+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:51.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:51 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:51.105+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:51.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:51 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:51.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:51.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:51 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:51.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:51.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:51 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:51.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:51.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:51 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:51.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:51.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:51 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:51.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:51.645 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:51 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:51.276+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:52.515 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.125+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:52.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.125+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:52.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.125+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:52.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.125+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:52.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.125+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:52.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.125+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6822 osd.6 since back 2026-02-19T21:10:29.710068+0000 front 2026-02-19T21:10:29.710097+0000 (oldest deadline 2026-02-19T21:10:51.410009+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:52.274+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:52.230115+0000 front 2026-02-19T21:09:52.230071+0000 (oldest deadline 2026-02-19T21:10:18.130047+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:52.274+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:09:58.130162+0000 front 2026-02-19T21:09:58.130173+0000 (oldest deadline 2026-02-19T21:10:23.430312+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:52.274+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:03.430515+0000 front 2026-02-19T21:10:03.430674+0000 (oldest deadline 2026-02-19T21:10:28.730531+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:52.274+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.90:6814 osd.3 since back 2026-02-19T21:10:13.231469+0000 front 2026-02-19T21:10:13.231316+0000 (oldest deadline 2026-02-19T21:10:34.931373+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:52.274+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:14.931564+0000 front 2026-02-19T21:10:14.931608+0000 (oldest deadline 2026-02-19T21:10:39.631589+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10[58707]: 2026-02-19T21:10:52.274+0000 7fb4e59e96c0 -1 osd.10 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:21.832200+0000 front 2026-02-19T21:10:21.832230+0000 (oldest deadline 2026-02-19T21:10:44.732139+0000) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 podman[66782]: 2026-02-19 21:10:52.355599717 +0000 UTC m=+5.091241393 container died 55231bb99c81df88a23a8f24a706f10c5b25cd501693f527ae2f5cbc728e6bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, io.buildah.version=1.41.3, version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 podman[66782]: 2026-02-19 21:10:52.363320807 +0000 UTC m=+5.098962473 container remove 55231bb99c81df88a23a8f24a706f10c5b25cd501693f527ae2f5cbc728e6bf1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, io.buildah.version=1.41.3, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 bash[66782]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 podman[66908]: 2026-02-19 21:10:52.490426162 +0000 UTC m=+0.014665750 container create ccb1583d03f472324c57512beca829d1b3452fb2cfddb6d648373fb681981cbd (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10-deactivate, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.version=10, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 podman[66908]: 2026-02-19 21:10:52.523078381 +0000 UTC m=+0.047317959 container init ccb1583d03f472324c57512beca829d1b3452fb2cfddb6d648373fb681981cbd (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10-deactivate, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, OSD_FLAVOR=default, summary=Rocky Linux Base image, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, license=BSD-3-Clause, name=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:10:52.525 INFO:journalctl@ceph.osd.10.trial105.stdout:Feb 19 21:10:52 trial105 podman[66908]: 2026-02-19 21:10:52.524946866 +0000 UTC m=+0.049186454 container start ccb1583d03f472324c57512beca829d1b3452fb2cfddb6d648373fb681981cbd (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-10-deactivate, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.41.3, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:10:52.699 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.10.service' 2026-02-19T21:10:52.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:52.745 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-19T21:10:52.745 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-19T21:10:52.745 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.11 2026-02-19T21:10:53.153 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.11.service - Ceph osd.11 for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:53.153 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.843+0000 7f1d7c0926c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-19T21:10:53.153 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.843+0000 7f1d7c0926c0 -1 osd.11 77 *** Got signal Terminated *** 2026-02-19T21:10:53.153 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:52 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:52.843+0000 7f1d7c0926c0 -1 osd.11 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-19T21:10:53.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:53 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:53.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:53.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:53 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:53.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:53.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:53 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:53.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:53.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:53 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:53.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:53.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:53 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:53.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:53.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:53 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:53.152+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6822 osd.6 since back 2026-02-19T21:10:29.710068+0000 front 2026-02-19T21:10:29.710097+0000 (oldest deadline 2026-02-19T21:10:51.410009+0000) 2026-02-19T21:10:54.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:54 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:54.113+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:54.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:54 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:54.113+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:54.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:54 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:54.113+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:54.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:54 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:54.113+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:54.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:54 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:54.113+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:54.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:54 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:54.113+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6822 osd.6 since back 2026-02-19T21:10:29.710068+0000 front 2026-02-19T21:10:29.710097+0000 (oldest deadline 2026-02-19T21:10:51.410009+0000) 2026-02-19T21:10:55.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:55 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:55.100+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:55.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:55 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:55.100+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:55.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:55 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:55.100+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:55.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:55 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:55.100+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:55.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:55 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:55.100+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:55.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:55 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:55.100+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6822 osd.6 since back 2026-02-19T21:10:29.710068+0000 front 2026-02-19T21:10:29.710097+0000 (oldest deadline 2026-02-19T21:10:51.410009+0000) 2026-02-19T21:10:56.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:56 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:56.061+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:56.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:56 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:56.061+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:56.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:56 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:56.061+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:56.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:56 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:56.061+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:56.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:56 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:56.061+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:56.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:56 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:56.061+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6822 osd.6 since back 2026-02-19T21:10:29.710068+0000 front 2026-02-19T21:10:29.710097+0000 (oldest deadline 2026-02-19T21:10:51.410009+0000) 2026-02-19T21:10:57.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6806 osd.0 since back 2026-02-19T21:09:53.607489+0000 front 2026-02-19T21:09:53.607554+0000 (oldest deadline 2026-02-19T21:10:17.107566+0000) 2026-02-19T21:10:57.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6804 osd.1 since back 2026-02-19T21:10:01.708274+0000 front 2026-02-19T21:10:01.708207+0000 (oldest deadline 2026-02-19T21:10:25.808277+0000) 2026-02-19T21:10:57.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6804 osd.2 since back 2026-02-19T21:10:07.508635+0000 front 2026-02-19T21:10:07.508595+0000 (oldest deadline 2026-02-19T21:10:29.808756+0000) 2026-02-19T21:10:57.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6812 osd.4 since back 2026-02-19T21:10:13.909305+0000 front 2026-02-19T21:10:13.909293+0000 (oldest deadline 2026-02-19T21:10:39.209224+0000) 2026-02-19T21:10:57.516 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.175:6812 osd.5 since back 2026-02-19T21:10:23.809742+0000 front 2026-02-19T21:10:23.809753+0000 (oldest deadline 2026-02-19T21:10:49.709821+0000) 2026-02-19T21:10:57.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.90:6822 osd.6 since back 2026-02-19T21:10:29.710068+0000 front 2026-02-19T21:10:29.710097+0000 (oldest deadline 2026-02-19T21:10:51.410009+0000) 2026-02-19T21:10:57.517 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11[59861]: 2026-02-19T21:10:57.029+0000 7f1d77f676c0 -1 osd.11 77 heartbeat_check: no reply from 10.20.193.105:6820 osd.7 since back 2026-02-19T21:10:31.410246+0000 front 2026-02-19T21:10:31.410211+0000 (oldest deadline 2026-02-19T21:10:56.110231+0000) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 podman[69204]: 2026-02-19 21:10:57.924677714 +0000 UTC m=+5.091674843 container died 52d332835d2488bbe5946bf049c2d3f09ce4f16b74b52c6c33529261dff09448 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 podman[69204]: 2026-02-19 21:10:57.933319197 +0000 UTC m=+5.100316336 container remove 52d332835d2488bbe5946bf049c2d3f09ce4f16b74b52c6c33529261dff09448 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11, license=BSD-3-Clause, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.41.3, org.opencontainers.image.licenses=BSD-3-Clause, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:57 trial175 bash[69204]: ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:58 trial175 podman[69327]: 2026-02-19 21:10:58.071299664 +0000 UTC m=+0.015523393 container create 43af9991d682129eda56676ded5d575443fb2fb94228eafb03d4eedca571c6a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, version=10, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:58 trial175 podman[69327]: 2026-02-19 21:10:58.105790447 +0000 UTC m=+0.050014186 container init 43af9991d682129eda56676ded5d575443fb2fb94228eafb03d4eedca571c6a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, version=10, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.version=10, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:58 trial175 podman[69327]: 2026-02-19 21:10:58.107855939 +0000 UTC m=+0.052079668 container start 43af9991d682129eda56676ded5d575443fb2fb94228eafb03d4eedca571c6a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:58 trial175 podman[69327]: 2026-02-19 21:10:58.108322756 +0000 UTC m=+0.052546495 container attach 43af9991d682129eda56676ded5d575443fb2fb94228eafb03d4eedca571c6a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11-deactivate, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux) 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:58 trial175 podman[69327]: 2026-02-19 21:10:58.064679681 +0000 UTC m=+0.008903410 image pull 355fa4dca387971ead0a8a8a99425f61abe39b8d4c736591aac3a47e3f166485 quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21 2026-02-19T21:10:58.242 INFO:journalctl@ceph.osd.11.trial175.stdout:Feb 19 21:10:58 trial175 podman[69327]: 2026-02-19 21:10:58.242541693 +0000 UTC m=+0.186765432 container died 43af9991d682129eda56676ded5d575443fb2fb94228eafb03d4eedca571c6a1 (image=quay.ceph.io/ceph-ci/ceph@sha256:e90074ecf17bb524750c2e43ab56ae4a59668fae6210de164866323aba0fdf21, name=ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, CEPH_SHA1=a1ac97f8290bb2544f44f608df68f43689827c55, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, CEPH_REF=wip-rocky10-branch-of-the-day-2026-02-06-1770413686, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause) 2026-02-19T21:10:58.279 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@osd.11.service' 2026-02-19T21:10:58.330 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:58.330 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-19T21:10:58.330 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-19T21:10:58.330 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.a 2026-02-19T21:10:58.656 INFO:journalctl@ceph.mds.a.trial090.stdout:Feb 19 21:10:58 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.a.service - Ceph mds.a for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:10:58.656 INFO:journalctl@ceph.mds.a.trial090.stdout:Feb 19 21:10:58 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-a[70970]: 2026-02-19T21:10:58.430+0000 7f53a8aaf6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:10:58.657 INFO:journalctl@ceph.mds.a.trial090.stdout:Feb 19 21:10:58 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-a[70970]: 2026-02-19T21:10:58.430+0000 7f53a8aaf6c0 -1 mds.a *** got signal Terminated *** 2026-02-19T21:10:59.486 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.a.service' 2026-02-19T21:10:59.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:10:59.532 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-19T21:10:59.532 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-19T21:10:59.532 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.d 2026-02-19T21:10:59.656 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:10:59 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.d.service - Ceph mds.d for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:00.156 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:10:59 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-d[70075]: 2026-02-19T21:10:59.667+0000 7f568f18d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:00.156 INFO:journalctl@ceph.mds.d.trial090.stdout:Feb 19 21:10:59 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-d[70075]: 2026-02-19T21:10:59.667+0000 7f568f18d6c0 -1 mds.d *** got signal Terminated *** 2026-02-19T21:11:00.708 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.d.service' 2026-02-19T21:11:00.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:00.752 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-19T21:11:00.752 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-19T21:11:00.752 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.g 2026-02-19T21:11:00.902 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:11:00 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.g.service - Ceph mds.g for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:01.156 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:11:00 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-g[70550]: 2026-02-19T21:11:00.900+0000 7f98f5b556c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:01.156 INFO:journalctl@ceph.mds.g.trial090.stdout:Feb 19 21:11:00 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-g[70550]: 2026-02-19T21:11:00.900+0000 7f98f5b556c0 -1 mds.g *** got signal Terminated *** 2026-02-19T21:11:01.939 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.g.service' 2026-02-19T21:11:01.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:01.981 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-19T21:11:01.981 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-19T21:11:01.981 DEBUG:teuthology.orchestra.run.trial090:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.j 2026-02-19T21:11:02.119 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:11:02 trial090 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.j.service - Ceph mds.j for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:02.406 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:11:02 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-j[69631]: 2026-02-19T21:11:02.118+0000 7f48f03b86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:02.406 INFO:journalctl@ceph.mds.j.trial090.stdout:Feb 19 21:11:02 trial090 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-j[69631]: 2026-02-19T21:11:02.118+0000 7f48f03b86c0 -1 mds.j *** got signal Terminated *** 2026-02-19T21:11:03.162 DEBUG:teuthology.orchestra.run.trial090:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.j.service' 2026-02-19T21:11:03.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:03.207 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-19T21:11:03.207 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-19T21:11:03.208 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.b 2026-02-19T21:11:03.645 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:11:03 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.b.service - Ceph mds.b for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:03.645 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:11:03 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-b[63509]: 2026-02-19T21:11:03.315+0000 7fc7b37806c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:03.645 INFO:journalctl@ceph.mds.b.trial105.stdout:Feb 19 21:11:03 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-b[63509]: 2026-02-19T21:11:03.315+0000 7fc7b37806c0 -1 mds.b *** got signal Terminated *** 2026-02-19T21:11:08.024 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.b.service' 2026-02-19T21:11:08.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:08.068 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-19T21:11:08.069 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-19T21:11:08.069 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.e 2026-02-19T21:11:08.214 INFO:journalctl@ceph.mds.e.trial105.stdout:Feb 19 21:11:08 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.e.service - Ceph mds.e for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:08.644 INFO:journalctl@ceph.mds.e.trial105.stdout:Feb 19 21:11:08 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-e[62817]: 2026-02-19T21:11:08.214+0000 7f90d17616c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:08.644 INFO:journalctl@ceph.mds.e.trial105.stdout:Feb 19 21:11:08 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-e[62817]: 2026-02-19T21:11:08.214+0000 7f90d17616c0 -1 mds.e *** got signal Terminated *** 2026-02-19T21:11:09.418 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.e.service' 2026-02-19T21:11:09.461 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:09.462 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-19T21:11:09.462 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-19T21:11:09.462 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.h 2026-02-19T21:11:09.599 INFO:journalctl@ceph.mds.h.trial105.stdout:Feb 19 21:11:09 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.h.service - Ceph mds.h for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:09.895 INFO:journalctl@ceph.mds.h.trial105.stdout:Feb 19 21:11:09 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-h[63164]: 2026-02-19T21:11:09.597+0000 7fa62b98a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:09.895 INFO:journalctl@ceph.mds.h.trial105.stdout:Feb 19 21:11:09 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-h[63164]: 2026-02-19T21:11:09.597+0000 7fa62b98a6c0 -1 mds.h *** got signal Terminated *** 2026-02-19T21:11:11.854 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.h.service' 2026-02-19T21:11:11.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:11.896 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-19T21:11:11.896 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-19T21:11:11.897 DEBUG:teuthology.orchestra.run.trial105:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.k 2026-02-19T21:11:12.031 INFO:journalctl@ceph.mds.k.trial105.stdout:Feb 19 21:11:11 trial105 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.k.service - Ceph mds.k for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:12.395 INFO:journalctl@ceph.mds.k.trial105.stdout:Feb 19 21:11:12 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-k[62469]: 2026-02-19T21:11:12.030+0000 7f4e7edfe6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:12.395 INFO:journalctl@ceph.mds.k.trial105.stdout:Feb 19 21:11:12 trial105 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-k[62469]: 2026-02-19T21:11:12.030+0000 7f4e7edfe6c0 -1 mds.k *** got signal Terminated *** 2026-02-19T21:11:13.060 DEBUG:teuthology.orchestra.run.trial105:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.k.service' 2026-02-19T21:11:13.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:13.102 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-19T21:11:13.102 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-19T21:11:13.102 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.c 2026-02-19T21:11:13.516 INFO:journalctl@ceph.mds.c.trial175.stdout:Feb 19 21:11:13 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.c.service - Ceph mds.c for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:13.516 INFO:journalctl@ceph.mds.c.trial175.stdout:Feb 19 21:11:13 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-c[64465]: 2026-02-19T21:11:13.206+0000 7f7e454906c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:13.516 INFO:journalctl@ceph.mds.c.trial175.stdout:Feb 19 21:11:13 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-c[64465]: 2026-02-19T21:11:13.207+0000 7f7e454906c0 -1 mds.c *** got signal Terminated *** 2026-02-19T21:11:14.279 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.c.service' 2026-02-19T21:11:14.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:14.326 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-19T21:11:14.326 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-19T21:11:14.326 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.f 2026-02-19T21:11:14.516 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:11:14 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.f.service - Ceph mds.f for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:14.516 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:11:14 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-f[64117]: 2026-02-19T21:11:14.432+0000 7f75686406c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:14.516 INFO:journalctl@ceph.mds.f.trial175.stdout:Feb 19 21:11:14 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-f[64117]: 2026-02-19T21:11:14.432+0000 7f75686406c0 -1 mds.f *** got signal Terminated *** 2026-02-19T21:11:15.580 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.f.service' 2026-02-19T21:11:15.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:15.624 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-19T21:11:15.624 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-19T21:11:15.624 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.i 2026-02-19T21:11:15.759 INFO:journalctl@ceph.mds.i.trial175.stdout:Feb 19 21:11:15 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.i.service - Ceph mds.i for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:16.016 INFO:journalctl@ceph.mds.i.trial175.stdout:Feb 19 21:11:15 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-i[64809]: 2026-02-19T21:11:15.759+0000 7f8a003716c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:16.016 INFO:journalctl@ceph.mds.i.trial175.stdout:Feb 19 21:11:15 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-i[64809]: 2026-02-19T21:11:15.759+0000 7f8a003716c0 -1 mds.i *** got signal Terminated *** 2026-02-19T21:11:16.877 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.i.service' 2026-02-19T21:11:16.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:16.920 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-19T21:11:16.920 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-19T21:11:16.920 DEBUG:teuthology.orchestra.run.trial175:> sudo systemctl stop ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.l 2026-02-19T21:11:17.063 INFO:journalctl@ceph.mds.l.trial175.stdout:Feb 19 21:11:16 trial175 systemd[1]: Stopping ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.l.service - Ceph mds.l for 34db945f-0dd6-11f1-890f-d404e6e7d460... 2026-02-19T21:11:17.516 INFO:journalctl@ceph.mds.l.trial175.stdout:Feb 19 21:11:17 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-l[63774]: 2026-02-19T21:11:17.063+0000 7f33d80a96c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-19T21:11:17.516 INFO:journalctl@ceph.mds.l.trial175.stdout:Feb 19 21:11:17 trial175 ceph-34db945f-0dd6-11f1-890f-d404e6e7d460-mds-l[63774]: 2026-02-19T21:11:17.063+0000 7f33d80a96c0 -1 mds.l *** got signal Terminated *** 2026-02-19T21:11:18.114 DEBUG:teuthology.orchestra.run.trial175:> sudo pkill -f 'journalctl -f -n 0 -u ceph-34db945f-0dd6-11f1-890f-d404e6e7d460@mds.l.service' 2026-02-19T21:11:18.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-19T21:11:18.157 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-19T21:11:18.158 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --force --keep-logs 2026-02-19T21:11:18.284 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:11:20.408 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --force --keep-logs 2026-02-19T21:11:20.535 INFO:teuthology.orchestra.run.trial105.stdout:Deleting cluster with fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:11:22.726 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --force --keep-logs 2026-02-19T21:11:22.856 INFO:teuthology.orchestra.run.trial175.stdout:Deleting cluster with fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:11:25.047 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:11:25.079 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:11:25.110 DEBUG:teuthology.orchestra.run.trial175:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-19T21:11:25.140 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-19T21:11:25.143 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial090/crash 2026-02-19T21:11:25.144 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash -- . 2026-02-19T21:11:25.170 INFO:teuthology.orchestra.run.trial090.stderr:tar: /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-19T21:11:25.171 INFO:teuthology.orchestra.run.trial090.stderr:tar: Error is not recoverable: exiting now 2026-02-19T21:11:25.173 DEBUG:teuthology.misc:Transferring archived files from trial105:/var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial105/crash 2026-02-19T21:11:25.174 DEBUG:teuthology.orchestra.run.trial105:> sudo tar c -f - -C /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash -- . 2026-02-19T21:11:25.202 INFO:teuthology.orchestra.run.trial105.stderr:tar: /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-19T21:11:25.202 INFO:teuthology.orchestra.run.trial105.stderr:tar: Error is not recoverable: exiting now 2026-02-19T21:11:25.204 DEBUG:teuthology.misc:Transferring archived files from trial175:/var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial175/crash 2026-02-19T21:11:25.205 DEBUG:teuthology.orchestra.run.trial175:> sudo tar c -f - -C /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash -- . 2026-02-19T21:11:25.233 INFO:teuthology.orchestra.run.trial175.stderr:tar: /var/lib/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-19T21:11:25.233 INFO:teuthology.orchestra.run.trial175.stderr:tar: Error is not recoverable: exiting now 2026-02-19T21:11:25.235 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-19T21:11:25.235 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-19T21:11:25.262 INFO:teuthology.orchestra.run.trial090.stdout:2026-02-19T21:02:57.468800+0000 mon.a (mon.0) 413 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:11:25.262 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-19T21:11:25.262 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -E '\[SEC\]' /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-19T21:11:25.331 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -E '\[ERR\]' /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-19T21:11:25.398 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -E '\[WRN\]' /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-19T21:11:25.465 INFO:teuthology.orchestra.run.trial090.stdout:2026-02-19T21:02:57.468800+0000 mon.a (mon.0) 413 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-19T21:11:25.466 INFO:tasks.cephadm:Compressing logs... 2026-02-19T21:11:25.466 DEBUG:teuthology.orchestra.run.trial090:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T21:11:25.507 DEBUG:teuthology.orchestra.run.trial105:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T21:11:25.509 DEBUG:teuthology.orchestra.run.trial175:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T21:11:25.531 INFO:teuthology.orchestra.run.trial090.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-19T21:11:25.531 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-19T21:11:25.531 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log 2026-02-19T21:11:25.531 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.a.log 2026-02-19T21:11:25.532 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.a.log 2026-02-19T21:11:25.532 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log: 60.3% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log.gz 2026-02-19T21:11:25.532 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.g.log 2026-02-19T21:11:25.532 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.6.log 2026-02-19T21:11:25.532 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.3.log 2026-02-19T21:11:25.533 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.x.log 2026-02-19T21:11:25.533 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.9.log 2026-02-19T21:11:25.533 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.d.log 2026-02-19T21:11:25.533 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.x.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.0.log 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.d.log: 94.9% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.a.log.gz 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial090.stderr: 95.0% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.g.log.gz 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.0.log: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.j.log 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial105.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-19T21:11:25.534 INFO:teuthology.orchestra.run.trial105.stderr:: No such file or directory 2026-02-19T21:11:25.535 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log 2026-02-19T21:11:25.535 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.k.log 2026-02-19T21:11:25.535 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.7.log 2026-02-19T21:11:25.535 INFO:teuthology.orchestra.run.trial090.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log: 94.9% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.d.log.gz 2026-02-19T21:11:25.535 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.b.log 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial090.stderr: 87.2% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log.gz 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial175.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial175.stderr: --verbose -- /var/log/ceph/cephadm.log 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.8.log 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log: 35.2% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log.gz 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial105.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.4.log 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.1.log 2026-02-19T21:11:25.536 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.b.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.e.log 2026-02-19T21:11:25.537 INFO:teuthology.orchestra.run.trial090.stderr: 91.0% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log.gz 2026-02-19T21:11:25.537 INFO:teuthology.orchestra.run.trial090.stderr: 95.0% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.j.log.gz 2026-02-19T21:11:25.537 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.f.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.11.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.f.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.c.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial175.stderr: 35.2% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.cephadm.log.gz 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial175.stderr: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.5.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.b.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.h.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr: 94.8% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.k.log.gz 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.b.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.10.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log 2026-02-19T21:11:25.538 INFO:teuthology.orchestra.run.trial090.stderr: 93.3% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log.gz 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.y.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.i.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.l.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.5.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.c.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial105.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.y.log: 87.2% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log.gz 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial105.stderr: 91.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log.gz 2026-02-19T21:11:25.539 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.z.log 2026-02-19T21:11:25.540 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.2.log 2026-02-19T21:11:25.540 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log: /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.z.log: 95.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.l.log.gz 2026-02-19T21:11:25.540 INFO:teuthology.orchestra.run.trial175.stderr:/var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.2.log: 87.2% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.log.gz 2026-02-19T21:11:25.540 INFO:teuthology.orchestra.run.trial105.stderr: 92.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-19T21:11:25.541 INFO:teuthology.orchestra.run.trial175.stderr: 91.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph.audit.log.gz 2026-02-19T21:11:25.541 INFO:teuthology.orchestra.run.trial105.stderr: 93.3% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log.gz 2026-02-19T21:11:25.542 INFO:teuthology.orchestra.run.trial175.stderr: 92.3% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-19T21:11:25.544 INFO:teuthology.orchestra.run.trial175.stderr: 93.8% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-volume.log.gz 2026-02-19T21:11:25.545 INFO:teuthology.orchestra.run.trial175.stderr: 95.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.f.log.gz 2026-02-19T21:11:25.545 INFO:teuthology.orchestra.run.trial105.stderr: 94.0% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.h.log.gz 2026-02-19T21:11:25.546 INFO:teuthology.orchestra.run.trial175.stderr: 94.3% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.i.log.gz 2026-02-19T21:11:25.547 INFO:teuthology.orchestra.run.trial105.stderr: 94.9% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.e.log.gz 2026-02-19T21:11:25.549 INFO:teuthology.orchestra.run.trial175.stderr: 94.5% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.c.log.gz 2026-02-19T21:11:25.564 INFO:teuthology.orchestra.run.trial105.stderr: 93.4% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mds.b.log.gz 2026-02-19T21:11:25.616 INFO:teuthology.orchestra.run.trial105.stderr: 92.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.b.log.gz 2026-02-19T21:11:25.618 INFO:teuthology.orchestra.run.trial090.stderr: 90.0% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-19T21:11:25.621 INFO:teuthology.orchestra.run.trial175.stderr: 92.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.c.log.gz 2026-02-19T21:11:25.621 INFO:teuthology.orchestra.run.trial175.stderr: 92.8% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.11.log.gz 2026-02-19T21:11:25.623 INFO:teuthology.orchestra.run.trial090.stderr: 92.4% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.9.log.gz 2026-02-19T21:11:25.626 INFO:teuthology.orchestra.run.trial090.stderr: 92.9% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.0.log.gz 2026-02-19T21:11:25.632 INFO:teuthology.orchestra.run.trial090.stderr: 92.7% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.3.log.gz 2026-02-19T21:11:25.634 INFO:teuthology.orchestra.run.trial175.stderr: 92.7% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.8.log.gz 2026-02-19T21:11:25.639 INFO:teuthology.orchestra.run.trial105.stderr: 93.0% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.7.log.gz 2026-02-19T21:11:25.640 INFO:teuthology.orchestra.run.trial090.stderr: 92.6% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.6.log.gz 2026-02-19T21:11:25.642 INFO:teuthology.orchestra.run.trial105.stderr: 92.5% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.4.log.gz 2026-02-19T21:11:25.643 INFO:teuthology.orchestra.run.trial175.stderr: 92.8% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.2.log.gz 2026-02-19T21:11:25.656 INFO:teuthology.orchestra.run.trial105.stderr: 93.1% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.1.log.gz 2026-02-19T21:11:25.679 INFO:teuthology.orchestra.run.trial175.stderr: 92.6% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.5.log.gz 2026-02-19T21:11:25.681 INFO:teuthology.orchestra.run.trial175.stderr: 2026-02-19T21:11:25.681 INFO:teuthology.orchestra.run.trial175.stderr:real 0m0.154s 2026-02-19T21:11:25.681 INFO:teuthology.orchestra.run.trial175.stderr:user 0m0.519s 2026-02-19T21:11:25.681 INFO:teuthology.orchestra.run.trial175.stderr:sys 0m0.053s 2026-02-19T21:11:25.690 INFO:teuthology.orchestra.run.trial105.stderr: 92.6% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-osd.10.log.gz 2026-02-19T21:11:25.691 INFO:teuthology.orchestra.run.trial105.stderr: 2026-02-19T21:11:25.691 INFO:teuthology.orchestra.run.trial105.stderr:real 0m0.166s 2026-02-19T21:11:25.691 INFO:teuthology.orchestra.run.trial105.stderr:user 0m0.578s 2026-02-19T21:11:25.691 INFO:teuthology.orchestra.run.trial105.stderr:sys 0m0.064s 2026-02-19T21:11:25.795 INFO:teuthology.orchestra.run.trial090.stderr: 90.3% -- replaced with /var/log/ceph/34db945f-0dd6-11f1-890f-d404e6e7d460/ceph-mon.a.log.gz 2026-02-19T21:11:25.797 INFO:teuthology.orchestra.run.trial090.stderr: 2026-02-19T21:11:25.797 INFO:teuthology.orchestra.run.trial090.stderr:real 0m0.275s 2026-02-19T21:11:25.797 INFO:teuthology.orchestra.run.trial090.stderr:user 0m0.714s 2026-02-19T21:11:25.797 INFO:teuthology.orchestra.run.trial090.stderr:sys 0m0.061s 2026-02-19T21:11:25.797 INFO:tasks.cephadm:Archiving logs... 2026-02-19T21:11:25.797 DEBUG:teuthology.misc:Transferring archived files from trial090:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial090/log 2026-02-19T21:11:25.799 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-19T21:11:25.962 DEBUG:teuthology.misc:Transferring archived files from trial105:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial105/log 2026-02-19T21:11:25.963 DEBUG:teuthology.orchestra.run.trial105:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-19T21:11:26.066 DEBUG:teuthology.misc:Transferring archived files from trial175:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial175/log 2026-02-19T21:11:26.067 DEBUG:teuthology.orchestra.run.trial175:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-19T21:11:26.161 INFO:tasks.cephadm:Removing cluster... 2026-02-19T21:11:26.161 DEBUG:teuthology.orchestra.run.trial090:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --force 2026-02-19T21:11:26.286 INFO:teuthology.orchestra.run.trial090.stdout:Deleting cluster with fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:11:26.462 DEBUG:teuthology.orchestra.run.trial105:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --force 2026-02-19T21:11:26.588 INFO:teuthology.orchestra.run.trial105.stdout:Deleting cluster with fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:11:26.771 DEBUG:teuthology.orchestra.run.trial175:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 34db945f-0dd6-11f1-890f-d404e6e7d460 --force 2026-02-19T21:11:26.896 INFO:teuthology.orchestra.run.trial175.stdout:Deleting cluster with fsid: 34db945f-0dd6-11f1-890f-d404e6e7d460 2026-02-19T21:11:27.077 INFO:tasks.cephadm:Removing cephadm ... 2026-02-19T21:11:27.077 DEBUG:teuthology.orchestra.run.trial090:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-19T21:11:27.097 DEBUG:teuthology.orchestra.run.trial105:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-19T21:11:27.117 DEBUG:teuthology.orchestra.run.trial175:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-19T21:11:27.135 INFO:tasks.cephadm:Teardown complete 2026-02-19T21:11:27.135 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_a1ac97f8290bb2544f44f608df68f43689827c55/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-19T21:11:27.136 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-19T21:11:27.147 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-19T21:11:27.164 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-19T21:11:27.165 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T21:11:27.168 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T21:11:27.170 DEBUG:teuthology.orchestra.run.trial175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-19T21:11:27.421 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-19T21:11:27.433 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-19T21:11:27.433 DEBUG:teuthology.orchestra.run.trial090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T21:11:27.435 DEBUG:teuthology.orchestra.run.trial105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T21:11:27.437 DEBUG:teuthology.orchestra.run.trial175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-19T21:11:27.452 INFO:teuthology.orchestra.run.trial090.stderr:bash: line 1: ntpq: command not found 2026-02-19T21:11:27.453 INFO:teuthology.orchestra.run.trial105.stderr:bash: line 1: ntpq: command not found 2026-02-19T21:11:27.454 INFO:teuthology.orchestra.run.trial175.stderr:bash: line 1: ntpq: command not found 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial105.stdout:=============================================================================== 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial105.stdout:^+ 139-177-202-26.ip.linode> 2 6 377 36 -6454us[-6454us] +/- 81ms 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial105.stdout:^* sensei.ruselabs.com 2 6 377 38 +1375us[+1437us] +/- 38ms 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial105.stdout:^+ ntp1.glypnod.com 2 6 377 36 +2220us[+2220us] +/- 45ms 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial105.stdout:^+ 149.28.200.179.vultruser> 2 6 377 37 +1258us[+1258us] +/- 41ms 2026-02-19T21:11:27.479 INFO:teuthology.orchestra.run.trial090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial090.stdout:=============================================================================== 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial090.stdout:^+ 139-177-202-26.ip.linode> 2 6 377 36 -6721us[-6721us] +/- 81ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial090.stdout:^* sensei.ruselabs.com 2 6 377 36 +99us[ +190us] +/- 39ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial090.stdout:^+ ntp1.glypnod.com 2 6 377 38 +2054us[+2145us] +/- 45ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial090.stdout:^+ 149.28.200.179.vultruser> 2 6 377 35 +709us[ +709us] +/- 41ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial175.stdout:=============================================================================== 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial175.stdout:^+ 172-234-25-10.ip.linodeu> 2 6 377 37 -5051us[-5140us] +/- 76ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial175.stdout:^+ sensei.ruselabs.com 2 6 377 35 -113us[ -113us] +/- 39ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial175.stdout:^* ntp1.glypnod.com 2 6 377 35 +1786us[+1697us] +/- 45ms 2026-02-19T21:11:27.480 INFO:teuthology.orchestra.run.trial175.stdout:^+ 149.28.200.179.vultruser> 2 6 377 36 +1454us[+1365us] +/- 42ms 2026-02-19T21:11:27.480 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-19T21:11:27.492 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-19T21:11:27.492 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-19T21:11:27.506 DEBUG:teuthology.orchestra.run.trial090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-19T21:11:27.583 DEBUG:teuthology.orchestra.run.trial105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-19T21:11:27.642 DEBUG:teuthology.orchestra.run.trial175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-19T21:11:27.701 DEBUG:teuthology.orchestra.run.trial090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-19T21:11:27.720 INFO:teuthology.orchestra.run.trial090.stderr:grep: Invalid content of \{\} 2026-02-19T21:11:27.731 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-19T21:11:27.731 DEBUG:teuthology.orchestra.run.trial105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-19T21:11:27.750 INFO:teuthology.orchestra.run.trial105.stderr:grep: Invalid content of \{\} 2026-02-19T21:11:27.760 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-19T21:11:27.761 DEBUG:teuthology.orchestra.run.trial175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-19T21:11:27.780 INFO:teuthology.orchestra.run.trial175.stderr:grep: Invalid content of \{\} 2026-02-19T21:11:27.790 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-19T21:11:27.791 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-19T21:11:27.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-19T21:11:27.823 INFO:teuthology.task.internal:Duration was 797.374429 seconds 2026-02-19T21:11:27.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-19T21:11:27.838 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-19T21:11:27.838 DEBUG:teuthology.orchestra.run.trial090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T21:11:27.841 DEBUG:teuthology.orchestra.run.trial105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T21:11:27.844 DEBUG:teuthology.orchestra.run.trial175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-19T21:11:27.880 INFO:teuthology.orchestra.run.trial090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T21:11:27.882 INFO:teuthology.orchestra.run.trial105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T21:11:27.884 INFO:teuthology.orchestra.run.trial175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-19T21:11:28.199 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-19T21:11:28.199 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial090.front.sepia.ceph.com 2026-02-19T21:11:28.200 DEBUG:teuthology.orchestra.run.trial090:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T21:11:28.259 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial105.front.sepia.ceph.com 2026-02-19T21:11:28.259 DEBUG:teuthology.orchestra.run.trial105:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T21:11:28.280 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial175.front.sepia.ceph.com 2026-02-19T21:11:28.281 DEBUG:teuthology.orchestra.run.trial175:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-19T21:11:28.303 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-19T21:11:28.303 DEBUG:teuthology.orchestra.run.trial090:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T21:11:28.305 DEBUG:teuthology.orchestra.run.trial105:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T21:11:28.322 DEBUG:teuthology.orchestra.run.trial175:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T21:11:28.517 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-19T21:11:28.517 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T21:11:28.520 DEBUG:teuthology.orchestra.run.trial105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T21:11:28.524 DEBUG:teuthology.orchestra.run.trial175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-19T21:11:28.544 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T21:11:28.544 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T21:11:28.544 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T21:11:28.544 INFO:teuthology.orchestra.run.trial090.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T21:11:28.545 INFO:teuthology.orchestra.run.trial090.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T21:11:28.548 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T21:11:28.549 INFO:teuthology.orchestra.run.trial105.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T21:11:28.549 INFO:teuthology.orchestra.run.trial105.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T21:11:28.550 INFO:teuthology.orchestra.run.trial105.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T21:11:28.550 INFO:teuthology.orchestra.run.trial105.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T21:11:28.552 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-19T21:11:28.553 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-19T21:11:28.553 INFO:teuthology.orchestra.run.trial175.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-19T21:11:28.554 INFO:teuthology.orchestra.run.trial175.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-19T21:11:28.554 INFO:teuthology.orchestra.run.trial175.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-19T21:11:28.565 INFO:teuthology.orchestra.run.trial105.stderr: 87.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T21:11:28.573 INFO:teuthology.orchestra.run.trial175.stderr: 87.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T21:11:28.589 INFO:teuthology.orchestra.run.trial090.stderr: 91.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-19T21:11:28.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-19T21:11:28.608 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-19T21:11:28.608 DEBUG:teuthology.orchestra.run.trial090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T21:11:28.661 DEBUG:teuthology.orchestra.run.trial105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T21:11:28.690 DEBUG:teuthology.orchestra.run.trial175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-19T21:11:28.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-19T21:11:28.734 DEBUG:teuthology.orchestra.run.trial090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T21:11:28.736 DEBUG:teuthology.orchestra.run.trial105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T21:11:28.739 DEBUG:teuthology.orchestra.run.trial175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-19T21:11:28.778 INFO:teuthology.orchestra.run.trial090.stdout:kernel.core_pattern = core 2026-02-19T21:11:28.782 INFO:teuthology.orchestra.run.trial105.stdout:kernel.core_pattern = core 2026-02-19T21:11:28.803 INFO:teuthology.orchestra.run.trial175.stdout:kernel.core_pattern = core 2026-02-19T21:11:28.823 DEBUG:teuthology.orchestra.run.trial090:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T21:11:28.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T21:11:28.841 DEBUG:teuthology.orchestra.run.trial105:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T21:11:28.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T21:11:28.858 DEBUG:teuthology.orchestra.run.trial175:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-19T21:11:28.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-19T21:11:28.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-19T21:11:28.893 INFO:teuthology.task.internal:Transferring archived files... 2026-02-19T21:11:28.894 DEBUG:teuthology.misc:Transferring archived files from trial090:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial090 2026-02-19T21:11:28.894 DEBUG:teuthology.orchestra.run.trial090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T21:11:28.948 DEBUG:teuthology.misc:Transferring archived files from trial105:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial105 2026-02-19T21:11:28.949 DEBUG:teuthology.orchestra.run.trial105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T21:11:28.987 DEBUG:teuthology.misc:Transferring archived files from trial175:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-19_12:04:07-fs-wip-rocky10-branch-of-the-day-2026-02-06-1770413686-distro-default-trial/58378/remote/trial175 2026-02-19T21:11:28.987 DEBUG:teuthology.orchestra.run.trial175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-19T21:11:29.024 INFO:teuthology.task.internal:Removing archive directory... 2026-02-19T21:11:29.025 DEBUG:teuthology.orchestra.run.trial090:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T21:11:29.026 DEBUG:teuthology.orchestra.run.trial105:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T21:11:29.028 DEBUG:teuthology.orchestra.run.trial175:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-19T21:11:29.077 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-19T21:11:29.091 INFO:teuthology.task.internal:Not uploading archives. 2026-02-19T21:11:29.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-19T21:11:29.115 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-19T21:11:29.116 DEBUG:teuthology.orchestra.run.trial090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T21:11:29.118 DEBUG:teuthology.orchestra.run.trial105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T21:11:29.121 DEBUG:teuthology.orchestra.run.trial175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-19T21:11:29.135 INFO:teuthology.orchestra.run.trial090.stdout: 786897 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 21:11 /home/ubuntu/cephtest 2026-02-19T21:11:29.138 INFO:teuthology.orchestra.run.trial105.stdout: 786897 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 21:11 /home/ubuntu/cephtest 2026-02-19T21:11:29.139 INFO:teuthology.orchestra.run.trial175.stdout: 786901 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 21:11 /home/ubuntu/cephtest 2026-02-19T21:11:29.140 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-19T21:11:29.158 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-19T21:11:29.205 INFO:teuthology.run:Summary data: description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{subvol} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iogen}} duration: 797.3744287490845 failure_reason: '"2026-02-19T21:02:57.468800+0000 mon.a (mon.0) 413 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-19T21:11:29.205 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-19T21:11:29.317 INFO:teuthology.run:FAIL